-- Logs begin at Mon 2022-09-26 05:02:40 UTC, end at Mon 2022-09-26 06:17:37 UTC. -- Sep 26 05:35:05.124194 dv-cinder-836083-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 05:35:05.133085 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 05:35:05 2022] *** Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: nodename: dv-cinder-836083-14-iscsi Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: machine: x86_64 Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: clock source: unix Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: pcre jit disabled Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: detected number of CPU cores: 4 Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: current working directory: / Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: detected binary path: /usr/bin/uwsgi-core Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: your processes number limit is 47680 Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: your memory page size is 4096 bytes Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: detected max file descriptor number: 2048 Sep 26 05:35:05.135236 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: lock engine: pthread robust mutexes Sep 26 05:35:05.136595 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: thunder lock: enabled Sep 26 05:35:05.136595 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 05:35:05.136595 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 05:35:05.176729 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: Python main interpreter initialized at 0x55f952cce9c0 Sep 26 05:35:05.176729 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: python threads support enabled Sep 26 05:35:05.176729 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: your server socket listen backlog is limited to 100 connections Sep 26 05:35:05.176729 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: your mercy for graceful operations on workers is 90 seconds Sep 26 05:35:05.177193 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 05:35:05.177193 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: *** Operational MODE: preforking *** Sep 26 05:35:05.177485 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: *** uWSGI is running in multiple interpreter mode *** Sep 26 05:35:05.177485 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: spawned uWSGI master process (pid: 112183) Sep 26 05:35:05.177716 dv-cinder-836083-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 05:35:05.179114 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: spawned uWSGI worker 1 (pid: 112184, cores: 1) Sep 26 05:35:05.179114 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: spawned uWSGI worker 2 (pid: 112185, cores: 1) Sep 26 05:35:05.179273 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 05:35:05.834456 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:35:05.839086 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:35:06.900767 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:35:06.900767 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: from cryptography.utils import int_from_bytes Sep 26 05:35:06.901624 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:35:06.901624 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: from cryptography.utils import int_from_bytes Sep 26 05:35:06.901752 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:35:06.901752 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: from cryptography.utils import int_from_bytes Sep 26 05:35:06.901752 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:35:06.901752 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: from cryptography.utils import int_from_bytes Sep 26 05:35:09.413155 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:35:09.413849 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:35:09.413948 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:35:09.413948 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:35:09.414404 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:35:09.414404 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:35:09.414544 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:35:09.414615 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:35:09.414687 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:35:09.414906 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.415023 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:35:09.415248 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.415391 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.415550 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.415704 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.415879 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.416036 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.416173 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.416293 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.416552 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.416665 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.416883 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.417015 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.417185 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.417282 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.417523 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.417673 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.417773 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.417859 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.418066 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.418210 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.418381 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.418525 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-14-iscsi {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.418691 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.418882 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-14-iscsi {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.418985 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.419076 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.419243 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.419354 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.419559 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.419655 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.419855 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.419958 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.420154 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.420254 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.420433 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.420562 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.420733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.420912 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.421243 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.421358 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.421549 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.421649 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.421846 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.421952 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.422192 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.422303 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.422472 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.422578 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.422785 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.422893 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.423088 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.423193 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.423398 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.423515 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.423717 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.423816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.424011 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.424102 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.424304 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.424410 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-14-iscsi {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.424689 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.424796 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-14-iscsi {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.424990 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.425123 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.425313 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.425404 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.425619 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.425713 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.426002 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.426102 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.426302 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.426397 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.426603 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.426696 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.426917 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.427035 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.427221 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.427356 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.427515 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.427604 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.427821 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.427914 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.428131 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.428226 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.428436 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.428578 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.428728 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.428823 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.429025 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.429160 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.429345 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.429432 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.429645 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.429732 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.429944 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.430052 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.430239 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.430327 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.430480 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.430618 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.430764 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.430862 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.431065 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.431152 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.431372 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.431464 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.431679 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.431773 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.431919 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.432015 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.432189 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.432287 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.432483 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.432570 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.432791 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.432926 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.433091 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.433260 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.433412 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.433501 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.433710 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.433802 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434007 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434143 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434304 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434400 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434601 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434799 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434905 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.434993 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.435179 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.435274 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.435477 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.435565 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.435782 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.435869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.436089 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.436182 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.436408 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.436499 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.436693 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.436782 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.437008 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.437173 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.437415 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.437503 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.437661 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.437749 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.437965 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.438060 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.438298 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.438642 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.438744 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.438834 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.438916 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.438995 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.439203 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.439308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.439495 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.439631 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.439799 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.439899 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.440097 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.440198 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.440399 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.440494 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.440710 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.440798 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441004 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441102 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441275 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441370 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441568 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441665 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441862 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.441956 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.442161 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.442248 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.442455 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.442555 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.442751 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.442846 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.443048 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.443135 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.443347 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.443483 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.443643 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.443740 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.443945 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.444039 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.444245 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.444338 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.444547 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.444636 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.444851 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.444991 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.445176 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.445270 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.445462 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.445557 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.445757 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.445850 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.446058 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.446156 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.446356 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.446443 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.446652 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.446738 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.446960 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.447054 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.447266 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.447363 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.447558 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.447654 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.447919 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.448028 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.448220 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.448309 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.448523 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.448624 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.448837 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.448932 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.449163 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.449270 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.449460 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.449546 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.449760 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.449855 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.450057 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.450143 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.450351 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.450444 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.450653 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.450769 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.450953 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.451045 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.451254 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.451353 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.451546 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.451645 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.451842 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.451928 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.452141 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.452229 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.452439 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.452525 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.452734 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.452828 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.453027 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.453119 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.453342 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.453445 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.453659 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.453799 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.453930 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.454016 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.454227 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.454314 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.454511 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.454607 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.454800 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.454885 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.455091 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.455184 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.455401 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.455499 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.455696 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.455781 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.455994 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.456081 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.456288 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.456374 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.456584 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.456682 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.456893 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:35:09.456991 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.457238 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.457328 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.457561 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.457664 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.457863 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.457949 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.458183 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.458278 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.458502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.458598 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.458809 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.458903 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.459112 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.459224 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.459415 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.459503 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.459725 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.459815 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.460026 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.460111 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.460327 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.460414 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.460628 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.460714 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.460929 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.461022 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.461261 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.461362 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.461578 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.461666 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.461886 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.461971 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.462195 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.462283 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.462497 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.462588 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.462795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.462881 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.463112 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.463207 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.463442 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.463530 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.463764 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.463868 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.464066 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.464154 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.464369 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.464456 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.464702 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.464797 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.465009 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.465168 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.465356 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.465443 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.465670 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.465768 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.465973 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.466068 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.466275 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.466360 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.466575 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.466671 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.466899 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.466985 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.467199 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.467296 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.467501 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.467604 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.467807 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.467899 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.468110 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.468203 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.468410 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.468503 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.468714 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.468798 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.469016 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.469102 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.469342 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.469439 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.469647 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.469741 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.469949 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.470034 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.470247 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.470341 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.470563 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.470647 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.470866 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.470952 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.471531 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.471639 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.471837 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.471924 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.472141 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.472226 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.472440 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.472533 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.472742 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.472842 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.473042 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.473210 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.473363 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.473462 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.473659 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.473764 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.473952 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.474050 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.474248 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.474332 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.474542 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.474628 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.474835 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.474930 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.475147 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.475285 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.475442 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.475538 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.475751 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.475845 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.476044 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.476129 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.476348 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.476442 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.476645 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.476739 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.476943 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.477029 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.477263 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.477353 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.477565 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.477659 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.477864 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.477951 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.478157 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.478252 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.478452 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.478538 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.478755 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.478839 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.479106 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.479200 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.479435 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.479541 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.479722 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.479816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.480018 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.480112 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.480315 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.480408 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.480614 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.480708 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.480914 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.481009 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.481240 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.481337 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.481540 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.481628 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.481840 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.481936 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.482140 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.482231 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.482442 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.482528 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.482802 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.482907 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.483076 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.483176 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.483374 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.483467 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.483682 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.483768 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.483995 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.484087 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.484302 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.484396 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.484597 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.484692 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.484893 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.484978 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.485207 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.485296 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.485506 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.485601 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.485797 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.485884 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.486092 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.486178 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.486382 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.486479 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.486674 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.486761 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.486968 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.487133 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.487264 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.487348 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.487556 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.487686 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.487850 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.487945 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.488146 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.488237 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.488438 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.488526 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.488730 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.488830 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.489023 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.489115 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.489344 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.489484 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.489663 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.489795 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.489962 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.490059 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.490299 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.490395 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.490605 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.490692 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.490918 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.491012 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.491222 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.491349 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.491528 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.491615 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.491825 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.491910 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.492125 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.492217 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.492424 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.492518 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.492725 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.492811 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.493029 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.493121 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.493355 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.493442 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.493659 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.493744 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.493957 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.494077 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.494259 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.494357 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.494558 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.494644 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.494890 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.494982 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.495181 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.495278 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.495485 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.495576 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.495793 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.495894 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.496120 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.496205 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.496427 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.496515 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.496738 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.496832 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.497037 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.497122 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.497361 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.497460 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.497662 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.497799 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.497963 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.498048 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.498263 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.498356 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.498564 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.498650 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.498868 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.498955 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.499165 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.499257 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.499469 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.499598 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.499768 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.499853 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.500067 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.500152 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.500365 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.500486 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.500688 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.500805 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.500957 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.501068 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.501285 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.501415 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.501591 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.501689 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.501912 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.502005 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.502209 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.502298 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.502511 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.502601 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.502824 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.502922 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.503124 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.503213 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.503424 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.503512 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.503724 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.503823 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504020 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504123 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504315 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504410 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504605 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504713 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504908 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.504997 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.505226 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.505323 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.505527 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.505634 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.505822 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.505910 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.506117 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.506203 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.506415 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.506510 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.506711 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.506798 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507005 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507089 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507302 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507398 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507605 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507700 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507905 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.507990 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.508211 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.508297 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.508521 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.508657 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.508816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.508946 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.509095 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.509247 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.509432 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.509563 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.509737 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.509840 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.510033 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.510122 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.510384 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.510476 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.510684 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.510785 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.510985 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.511072 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.511319 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.511412 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.511614 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.511734 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.511911 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.511998 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.512218 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.512305 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.512519 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.512616 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.512823 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.512909 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.513123 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.513273 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.513443 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.513532 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.513743 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.513830 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.514044 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.514135 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.514342 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.514486 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.514641 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.514726 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.514939 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.515032 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.515241 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.515332 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.515541 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.515636 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.515843 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.515945 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.516137 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.516225 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.516456 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.516584 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.516751 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.516858 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.517034 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.517120 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.517363 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.517450 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.517668 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.517768 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.517980 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.518245 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.518548 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.518642 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.518860 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.518954 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.519168 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.519254 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.519480 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.519611 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.519807 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.519971 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.520114 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.520251 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.520429 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.520571 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.520711 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.520843 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.521013 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.521194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.521333 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.521460 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.521619 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.521768 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.521908 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.522053 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.522183 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.522343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.522534 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.522662 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.522785 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.522928 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.523044 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.523128 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.523349 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.523484 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.523611 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.523709 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.523930 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.524064 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.524227 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.524372 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.524472 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.524551 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.524773 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.524878 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.525062 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.525191 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.525389 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.525480 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.525683 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.525813 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.526039 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.526138 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.526341 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.526427 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.526634 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.526726 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.526924 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.527025 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.527216 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.527316 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.527518 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.527605 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.527831 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.527936 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.528136 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.528213 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.528462 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.528547 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.528781 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.528889 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.529075 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.529222 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.529393 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.529493 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.529706 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.529795 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530007 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530103 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530301 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530386 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530594 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530680 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530890 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.530974 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.531185 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.531271 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.531478 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.531565 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.531771 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.531865 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.532071 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.532157 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.532373 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.532460 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.532670 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.532756 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.532961 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.533049 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.533279 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.533372 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.533573 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.533667 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.533867 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.533970 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.534167 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.534342 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.534474 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.534608 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.534727 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.534850 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.535044 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.535196 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.535305 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.535381 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.535594 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.535695 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.535887 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.536020 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.536176 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.536263 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.536469 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.536571 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.536763 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.536857 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.537055 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.537169 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.537370 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.537466 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.537664 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.537750 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.537959 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.538043 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.538253 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.538351 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.538551 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.538691 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.538857 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.538950 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.539150 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.539247 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.539442 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.539537 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.539734 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.539822 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540027 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540121 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540319 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540412 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540612 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540707 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540908 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.540994 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.541244 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.541334 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.541571 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.541680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.541870 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.541956 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.542163 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.542256 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.542464 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.542622 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.542755 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.542897 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543043 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543176 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543311 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543457 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543589 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543721 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543854 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.543987 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.544130 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.544264 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.544407 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.544537 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.544722 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.544863 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.545004 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.545162 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.545365 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.545528 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.545662 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.545797 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.545944 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.546143 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.546281 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.546411 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.546556 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.546689 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.546837 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.546969 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.547110 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.547243 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.547404 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.547556 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.547692 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.547826 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.548004 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.548143 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.548289 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.548481 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.548631 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.548766 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.548913 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.549047 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.549279 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.549432 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.549564 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.549710 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.549848 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.549982 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.550110 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.550258 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.550406 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.550541 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.550670 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.550806 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.550959 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.551095 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.551240 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.551378 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.551514 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.551656 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.551802 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.551937 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.552103 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.552254 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.552391 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.552525 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.552671 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.552804 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.552948 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.553097 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.553319 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.553456 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.553609 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.553723 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.553837 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.553925 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.554138 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.554225 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.554441 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.554529 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.554739 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.554826 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.555040 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.555175 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.555344 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.555434 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.555636 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.555734 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.555934 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.556034 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.556227 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.556321 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.556519 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.556605 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.556812 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.556907 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.557189 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.557290 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.557510 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.557619 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.557812 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.557903 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.558108 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.558195 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.558408 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.558532 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.558702 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.558793 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.559019 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.559121 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.559432 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.559522 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.559736 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.559822 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.560039 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.560198 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.560337 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.560432 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.560636 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.560723 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.560938 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.561030 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.561265 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.561354 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.561566 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.561655 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.561861 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.561955 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.562262 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.562363 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.562594 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.562690 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.562869 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.562963 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.563170 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.563301 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.563456 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.563543 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.563751 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.563839 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.564054 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.564154 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.564347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.564432 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.564642 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.564728 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.564935 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.565029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.565258 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.565419 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.565551 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.565650 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.565857 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.565945 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.566170 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.566265 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.566548 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.566641 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.566845 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.566934 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.567144 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.567250 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.567552 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.567646 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.567852 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.567946 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.568150 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.568245 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.568463 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.568555 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.568782 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.568991 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.569199 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.569356 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.569560 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.569710 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.569859 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.570022 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.570232 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.570383 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.570533 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.570684 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.570832 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.570993 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.571135 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.571279 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.571429 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.571581 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.571732 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.571905 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.572055 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.572206 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.572354 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.572498 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.572646 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.572809 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.572809 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.573089 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.573089 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.573400 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.573553 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.573692 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.573835 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.573974 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.574142 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.574291 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.574448 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.574611 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.574757 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.574905 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.575052 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.575197 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.575413 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.575566 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.575710 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.575856 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.575996 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.576150 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.576411 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.576553 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.576696 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.576843 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.577001 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.577215 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.577386 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.577544 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.577685 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.577828 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.577960 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.578101 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.578258 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.578396 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.578549 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.578702 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.578870 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579025 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579156 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579283 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579412 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579550 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579688 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579833 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.579965 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580080 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580206 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580335 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580475 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580606 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580736 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580860 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.580993 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.581158 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.581316 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.581444 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.581577 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.581711 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.581837 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.581955 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582097 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582224 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582344 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582469 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582595 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582713 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582844 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.582959 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.583096 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.583223 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.583371 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.583520 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.583656 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.583798 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.583927 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.584057 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.584199 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.584343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.584476 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.584625 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.584754 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.584886 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.585057 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.585462 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.585861 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.585995 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.586129 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.586271 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.586409 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.586551 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.586683 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.586821 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.586959 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.587090 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.587262 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.587416 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.587546 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.587678 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.587818 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.587950 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.588099 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.588231 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.588421 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.588554 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.588685 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.588815 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.588931 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589011 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589080 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589170 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589382 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589562 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589645 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589753 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.589843 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.590027 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.590216 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.590366 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.590519 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.590663 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.590804 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.590943 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.591101 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.591242 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.591394 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.591529 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.591675 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.591806 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.591950 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.592093 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.592255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.592399 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.592536 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.592680 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.592836 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.592982 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.593166 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.593313 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.593461 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.593635 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.593792 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.593931 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.594074 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.594215 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.594358 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.594617 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.594767 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.595020 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.595172 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.595343 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.595496 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.595655 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.595859 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.596017 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.596514 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.596660 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.596809 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.596965 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.597126 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.597349 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.597493 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.597668 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.597824 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.597969 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.598115 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.598260 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.598416 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.598559 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.598714 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.598859 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.599002 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.599145 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.599289 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.599491 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.599662 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.599806 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.599950 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.600094 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.600238 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.600406 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.600551 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.600694 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.600838 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.600991 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.601158 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.601321 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.601468 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.601626 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.601771 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.601916 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.602074 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.602220 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.602363 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.602510 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.602653 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.602795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.602952 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.603106 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.603248 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.603388 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.603529 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.603789 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.603931 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.604075 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.604218 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.604364 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.604523 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.604680 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.604823 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.604977 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.605119 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.605305 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.605450 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.605609 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.605756 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.605884 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.606026 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.606171 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.606326 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.606497 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.606642 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.606792 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.606936 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.607091 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.607256 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.607400 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.607545 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.607702 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.607845 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.607985 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.608139 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.608292 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.608437 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.608579 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.608722 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.608867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.609024 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.609194 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.609356 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.609500 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.609500 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.609782 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.609929 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.610071 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.610207 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.610345 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.610489 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.610647 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.610807 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.610955 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.611101 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.611248 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.611397 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.611553 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.611680 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.611802 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.611930 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.612068 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.612068 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.612333 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.612466 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.612600 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.612897 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.613047 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.613254 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.613391 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.613538 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.613672 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.613806 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.613945 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.614092 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.614333 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.614483 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.614616 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.614751 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.614888 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615032 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615177 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615322 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615456 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615590 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615726 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615871 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.615988 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.616104 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.616232 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.616377 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.616510 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.616717 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.616863 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.617003 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.617181 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.617332 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.617482 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.617618 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.617759 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.617902 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.618044 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.618178 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.618322 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.618464 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.618597 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.618728 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.618859 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.619002 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.619151 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.619289 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.619437 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.619573 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.619811 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.619950 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.620090 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.620237 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.620375 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.620511 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.620658 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.620790 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.620927 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.621063 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.621282 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.621413 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.621540 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.621692 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.621830 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.621969 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.622098 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.622231 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.622363 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.622508 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.622642 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.622780 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.622912 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.623089 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.623247 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.623399 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.623539 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.623677 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.623813 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.623948 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.624102 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.624241 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.624393 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.624540 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.624673 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.624817 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.624973 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.625176 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.625324 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.625484 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.625629 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.625884 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.626046 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.626196 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.626425 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.626674 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.626819 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.626982 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.627126 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.627306 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.627451 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.627594 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.627737 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.627874 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.628010 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.628168 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.628306 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.628486 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.628626 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.628771 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.628916 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.629076 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.629251 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.629413 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.629555 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.629726 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.629927 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.630094 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.630230 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.630370 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.630515 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.630650 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.630832 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.630979 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.631112 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.631244 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.631518 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.631663 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.631807 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.631940 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.632071 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.632202 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.632346 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.632479 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.632620 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.632756 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.632889 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.633033 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.633255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.633255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.633501 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.633634 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.633765 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.633921 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.634055 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.634189 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.634321 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.634454 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.634600 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.634747 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.634883 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.635018 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.635153 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.635312 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.635452 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.635591 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.635725 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.635890 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.636031 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.636207 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.636352 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.636514 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.636711 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.636845 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.636982 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.637111 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.637456 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.637596 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.637826 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.638142 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.638301 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.638461 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.638602 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.638757 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.638895 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.639032 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.639168 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.639337 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.639487 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.639638 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.639778 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.639952 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.640097 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.640310 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.640452 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.640587 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.640730 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.640870 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.641018 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.641215 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.641352 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.641483 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.641618 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.641796 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.641965 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.642107 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.642251 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.642396 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.642540 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.642687 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.642848 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.642997 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.643151 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.643317 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.643462 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.643620 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.643769 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.643905 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.644039 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.644170 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.644299 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.644442 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.644591 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.644733 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.644883 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.645017 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.645205 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.645372 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.645521 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.645665 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.645802 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.645937 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.646065 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.646208 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.646343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.646461 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.646649 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.646791 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.646960 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.647103 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.647250 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.647398 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.647569 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.647722 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.647867 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.647996 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.648122 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.648243 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.648361 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.648488 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.648625 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.648753 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.648877 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.649002 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.649126 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.649126 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.649488 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.649631 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.649759 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.649884 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.650017 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.650220 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.650357 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.650489 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.650622 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.650755 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.650942 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.651098 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.651245 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.651381 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.651514 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.651647 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.651783 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.651936 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.652070 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.652244 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.652393 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.652562 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.652711 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.652856 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.652988 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.653190 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.653347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.653480 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.653625 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.653802 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.653938 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.654082 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.654217 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.654352 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.654497 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.654667 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.654803 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.654969 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.655119 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.655265 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.655412 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.655546 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.655692 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.655838 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.655973 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.656152 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.656290 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.656435 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.656570 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.656763 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.656900 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.657046 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.657340 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.657477 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.657612 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.657745 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.657899 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.658046 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.658183 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.658316 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.658447 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.658579 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.658832 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.658967 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.659101 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.659233 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.659368 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.659504 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.659648 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.659795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.659928 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.660061 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.660193 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.660316 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.660446 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.660632 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.660772 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.660905 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.661042 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.661198 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.661360 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.661499 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.661636 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.661804 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.661949 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.662106 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.662252 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.662433 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.662576 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.662754 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.662909 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.663067 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.663206 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.663347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.663606 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.663740 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.663877 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.664017 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:35:09.664147 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.664273 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:35:09.664487 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:35:09.820936 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO dbcounter [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Registered counter for database nova_api Sep 26 05:35:09.821508 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO dbcounter [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Registered counter for database nova_api Sep 26 05:35:09.841968 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_db.sqlalchemy.engines [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:09.843300 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_db.sqlalchemy.engines [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:09.849504 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writer thread running {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:09.850715 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writer thread running {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:09.906898 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.context [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efcbfa72-6b16-406c-b5c5-ca53c6356a25(cell1) {{(pid=112185) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:35:09.907171 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.context [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efcbfa72-6b16-406c-b5c5-ca53c6356a25(cell1) {{(pid=112184) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:35:09.910849 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:09.911052 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_concurrency.lockutils [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:09.911294 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_concurrency.lockutils [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:09.911426 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:09.912828 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:09.912973 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_concurrency.lockutils [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:09.913748 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_concurrency.lockutils [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:09.913857 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:35:09.913961 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:09.914046 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_concurrency.lockutils [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:35:09.915979 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:09.916126 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_concurrency.lockutils [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:35:09.918103 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO dbcounter [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Registered counter for database nova_cell0 Sep 26 05:35:09.918261 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO dbcounter [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Registered counter for database nova_cell0 Sep 26 05:35:09.922183 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO dbcounter [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Registered counter for database nova_cell1 Sep 26 05:35:09.922327 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO dbcounter [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Registered counter for database nova_cell1 Sep 26 05:35:09.929362 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_db.sqlalchemy.engines [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:09.931478 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_db.sqlalchemy.engines [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:09.935064 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_db.sqlalchemy.engines [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:09.936215 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_db.sqlalchemy.engines [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:09.938205 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writer thread running {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:09.938961 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writer thread running {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:10.076685 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writer thread running {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:10.079795 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writer thread running {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:10.085736 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO dbcounter [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Registered counter for database nova_cell0 Sep 26 05:35:10.090531 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO dbcounter [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Registered counter for database nova_cell0 Sep 26 05:35:10.093179 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_db.sqlalchemy.engines [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:10.098964 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writer thread running {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:10.100110 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG oslo_db.sqlalchemy.engines [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:35:10.105068 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writer thread running {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:35:10.435475 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: WARNING keystonemiddleware.auth_token [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:35:10.442666 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: WARNING keystonemiddleware.auth_token [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:35:10.446231 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: WARNING keystonemiddleware.auth_token [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:35:10.453776 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: WARNING keystonemiddleware.auth_token [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:35:10.785270 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: WARNING keystonemiddleware.auth_token [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:35:10.791069 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: WARNING keystonemiddleware.auth_token [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:35:10.796394 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f952cce9c0 pid: 112185 (default app) Sep 26 05:35:10.798491 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:35:10.799659 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Sep 26 05:35:10.800097 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Mon Sep 26 05:35:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:35:10.802257 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: WARNING keystonemiddleware.auth_token [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:35:10.808346 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: WARNING keystonemiddleware.auth_token [None req-a77ff07f-13b2-4737-92ed-1d2ca7e1e223 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:35:10.813668 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f952cce9c0 pid: 112184 (default app) Sep 26 05:36:35.871254 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:35.872177 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 26 05:36:35.872564 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:35.885704 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_api:SELECT=3 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:35.886653 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_cell0:SELECT=3 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:35.887643 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_cell1:SELECT=3 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:35.889752 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:36.889568 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-84d34def-7564-468e-9ae3-7cf3a7572a8d admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:36.924781 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-84d34def-7564-468e-9ae3-7cf3a7572a8d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.044696 Sep 26 05:36:36.926384 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Sep 26 05:36:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:39.821325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:39.823111 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-24c80082-bc86-4e49-8202-5a8b75dd756b None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002394 Sep 26 05:36:39.823931 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:36:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:40.489273 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-7bd1690c-52ab-4fd5-b3e5-a390a44da28b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "id": "c1", "swap": 0, "vcpus": 1, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:40.538660 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-7bd1690c-52ab-4fd5-b3e5-a390a44da28b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.688963 Sep 26 05:36:40.539233 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:36:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:36:40.553409 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_api:SELECT=3 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:40.554603 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_cell1:SELECT=3 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:40.556930 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_cell0:SELECT=3 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:40.557733 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:40.805392 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-d978fa37-95ac-4f75-82dd-b4d43ea95c48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:40.918335 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-d978fa37-95ac-4f75-82dd-b4d43ea95c48 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369827 Sep 26 05:36:40.919304 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Sep 26 05:36:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:44.335585 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-7bd1690c-52ab-4fd5-b3e5-a390a44da28b admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:44.337523 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-7bd1690c-52ab-4fd5-b3e5-a390a44da28b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002542 Sep 26 05:36:44.338525 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:36:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:45.182379 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-43012a24-efbf-4879-9034-ac56cf0b7d4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "swap": 0, "vcpus": 1}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:45.232853 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-43012a24-efbf-4879-9034-ac56cf0b7d4c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.883246 Sep 26 05:36:45.234023 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:36:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:36:45.247587 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-51600dd5-8ee7-4962-b91c-f0b70cd2de50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:45.292707 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-51600dd5-8ee7-4962-b91c-f0b70cd2de50 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050410 Sep 26 05:36:45.293885 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Sep 26 05:36:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:47.986738 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-43012a24-efbf-4879-9034-ac56cf0b7d4c admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:47.987783 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-43012a24-efbf-4879-9034-ac56cf0b7d4c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Sep 26 05:36:47.988600 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:48.456332 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-a9bd1128-6ac2-4fde-b802-a53e2b092fd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:48.479825 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-a9bd1128-6ac2-4fde-b802-a53e2b092fd7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483928 Sep 26 05:36:48.480397 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:36:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:36:48.494055 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-36a77d19-d1ad-496c-a70b-87f76ff73d7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:48.525849 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-36a77d19-d1ad-496c-a70b-87f76ff73d7b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035840 Sep 26 05:36:48.526448 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Sep 26 05:36:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:51.328627 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-a9bd1128-6ac2-4fde-b802-a53e2b092fd7 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:51.330440 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-a9bd1128-6ac2-4fde-b802-a53e2b092fd7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002776 Sep 26 05:36:51.331335 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:51.860875 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-ec7932c5-6990-42a8-81cd-01f8fbc6a906 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:51.890696 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-ec7932c5-6990-42a8-81cd-01f8fbc6a906 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552107 Sep 26 05:36:51.891620 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:36:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:36:51.908725 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-95e15e69-ebe3-464d-a81b-19d5c525be05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:51.953066 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-95e15e69-ebe3-464d-a81b-19d5c525be05 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051953 Sep 26 05:36:51.954200 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Sep 26 05:36:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:54.800879 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-ec7932c5-6990-42a8-81cd-01f8fbc6a906 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:54.803063 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-ec7932c5-6990-42a8-81cd-01f8fbc6a906 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Sep 26 05:36:54.808910 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:36:55.327702 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-1132b150-7af4-4d68-960b-176e5ad97970 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "vcpus": 4}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:55.348731 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-1132b150-7af4-4d68-960b-176e5ad97970 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538793 Sep 26 05:36:55.349549 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:36:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:36:55.362872 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-7a852c75-a26e-4c38-9cb4-7bfdf067e19a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:36:55.393606 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-7a852c75-a26e-4c38-9cb4-7bfdf067e19a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034683 Sep 26 05:36:55.394713 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1336 bytes} [Mon Sep 26 05:36:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:36:58.354916 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-1132b150-7af4-4d68-960b-176e5ad97970 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:58.355958 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-1132b150-7af4-4d68-960b-176e5ad97970 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Sep 26 05:36:58.356380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:36:58.901293 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-d224b3f7-5ac8-49c5-9026-39cb59e37183 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:36:58.962894 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-d224b3f7-5ac8-49c5-9026-39cb59e37183 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.598832 Sep 26 05:36:58.964029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Sep 26 05:36:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:37:01.696871 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-1132b150-7af4-4d68-960b-176e5ad97970 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:01.698129 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-1132b150-7af4-4d68-960b-176e5ad97970 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002435 Sep 26 05:37:01.698566 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:37:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:02.177620 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-6abab7da-992f-403d-9ebc-ae4d7e3cd21b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "vcpus": 1, "swap": 0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:02.199259 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-6abab7da-992f-403d-9ebc-ae4d7e3cd21b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.494059 Sep 26 05:37:02.199984 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:37:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:02.212197 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-bab47d84-6cd6-400e-8f3b-2ae28590febc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:02.243314 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-bab47d84-6cd6-400e-8f3b-2ae28590febc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034836 Sep 26 05:37:02.243908 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Sep 26 05:37:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:37:04.972630 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-6abab7da-992f-403d-9ebc-ae4d7e3cd21b admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:04.973692 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-6abab7da-992f-403d-9ebc-ae4d7e3cd21b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Sep 26 05:37:04.974092 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:37:05.583451 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-167beec3-b53a-49ae-8eab-0149dd9d38ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "id": "2"}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:05.608938 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-167beec3-b53a-49ae-8eab-0149dd9d38ff admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.628129 Sep 26 05:37:05.609812 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:37:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:05.627579 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-2d727eeb-2644-4b07-abce-d7089b2daae1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:05.682941 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-2d727eeb-2644-4b07-abce-d7089b2daae1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059838 Sep 26 05:37:05.684046 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Sep 26 05:37:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:08.568251 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-167beec3-b53a-49ae-8eab-0149dd9d38ff admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:08.570285 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-167beec3-b53a-49ae-8eab-0149dd9d38ff admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002493 Sep 26 05:37:08.570991 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:37:09.174264 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-22ca003d-34d1-478d-b74d-94f8e89f6368 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "id": "3", "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:09.202196 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-22ca003d-34d1-478d-b74d-94f8e89f6368 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.624332 Sep 26 05:37:09.203072 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:37:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:09.215609 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-aeaa93b8-5e55-449d-bfe1-cf4e5f5d87b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:09.221636 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:09.255580 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-aeaa93b8-5e55-449d-bfe1-cf4e5f5d87b9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043680 Sep 26 05:37:09.269211 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Sep 26 05:37:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:12.567216 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-22ca003d-34d1-478d-b74d-94f8e89f6368 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:12.567216 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-22ca003d-34d1-478d-b74d-94f8e89f6368 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 26 05:37:12.572234 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:37:13.189835 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-115ac9f9-1219-473b-9601-d4ac3d4f5064 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:13.213101 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-115ac9f9-1219-473b-9601-d4ac3d4f5064 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.640108 Sep 26 05:37:13.213960 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:37:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:13.231836 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-c2ed7e50-e5ba-4426-b2cb-bc0a4969edea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:13.244257 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:13.272237 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-c2ed7e50-e5ba-4426-b2cb-bc0a4969edea admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048647 Sep 26 05:37:13.285183 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Sep 26 05:37:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:16.091937 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-115ac9f9-1219-473b-9601-d4ac3d4f5064 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:16.091937 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-115ac9f9-1219-473b-9601-d4ac3d4f5064 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 26 05:37:16.091937 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:16.639381 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-7e2dc639-9113-4a9d-883c-ce59907d188f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:16.661270 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-7e2dc639-9113-4a9d-883c-ce59907d188f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.574177 Sep 26 05:37:16.662201 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1283 bytes} [Mon Sep 26 05:37:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:16.680282 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-748fb3db-c92d-4b22-b0e9-4c32e362db33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:16.720947 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-748fb3db-c92d-4b22-b0e9-4c32e362db33 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047244 Sep 26 05:37:16.722286 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1333 bytes} [Mon Sep 26 05:37:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:37:32.606307 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-7e2dc639-9113-4a9d-883c-ce59907d188f admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:32.607323 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-7e2dc639-9113-4a9d-883c-ce59907d188f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 26 05:37:32.607697 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:32.618545 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:33.099631 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-818b973c-b480-44ca-8aff-a82bfcd73da8 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:33.119627 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-818b973c-b480-44ca-8aff-a82bfcd73da8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.505480 Sep 26 05:37:33.120199 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Sep 26 05:37:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:37:34.478550 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-7e2dc639-9113-4a9d-883c-ce59907d188f admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:34.479601 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-7e2dc639-9113-4a9d-883c-ce59907d188f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 26 05:37:34.480033 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:35.089495 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-50ed0d2d-00ad-4825-9770-4b3cefdad800 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:35.095364 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.wsgi [None req-50ed0d2d-00ad-4825-9770-4b3cefdad800 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-50ed0d2d-00ad-4825-9770-4b3cefdad800 admin admin] Request method failure captured: Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Accept: application/json Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Accept-Encoding: gzip, deflate Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Connection: keep-alive Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Content-Length: 0 Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Host: 10.222.0.57 Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Openstack-Api-Version: compute 2.92 Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Openstack-System-Scope: None Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: User-Agent: python-novaclient Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Auth-Token: gAAAAABjMTqeB2M-LeRy0p31k-tnWflBYai-iofRphhz8zY5rfdc6IHHBiBUtnQHujuUP8DppYk7PD-cwFeTSQFXMSzlw9SuwfHW0k1LZYOKfdjKzt2cXPkVGIRRx1OkhFtqUasJS87j11-oHcXt66NGz_5coGg8uxOMTExckye9hfQjNmoY6y4 Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Domain-Id: None Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Domain-Name: None Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Identity-Status: Confirmed Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Is-Admin-Project: True Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Domain-Id: default Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Domain-Name: Default Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Name: admin Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Role: admin,member,reader Sep 26 05:37:35.098680 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Roles: admin,member,reader Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb1661fcfa594d16a5b5329ef20333a6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant: admin Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant-Name: admin Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User: admin Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Domain-Id: default Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Domain-Name: Default Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Id: 7236c9ce10b9442581cf096a5b4cddf9 Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Name: admin Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: method: > Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: exception: Flavor 42 could not be found. Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: action_args: {'id': '42'} Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:35.100343 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:35.101380 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.102733 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-50ed0d2d-00ad-4825-9770-4b3cefdad800 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:35.104452 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-50ed0d2d-00ad-4825-9770-4b3cefdad800 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.480674 Sep 26 05:37:35.104452 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Sep 26 05:37:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 482 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:35.110478 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-a03103ab-83f6-40a6-92d1-ebbdb53adfa4 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:35.114802 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:35.135038 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-a03103ab-83f6-40a6-92d1-ebbdb53adfa4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028205 Sep 26 05:37:35.135620 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Sep 26 05:37:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:35.146792 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-0b390cca-ec3c-4d03-8d80-a3e33b1bcd83 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:35.169611 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-0b390cca-ec3c-4d03-8d80-a3e33b1bcd83 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027214 Sep 26 05:37:35.170085 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Sep 26 05:37:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:35.180553 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-07c48d71-8824-4c08-8627-e2116e04fcbb admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:35.186695 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.wsgi [None req-07c48d71-8824-4c08-8627-e2116e04fcbb admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-07c48d71-8824-4c08-8627-e2116e04fcbb admin admin] Request method failure captured: Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Accept: application/json Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Accept-Encoding: gzip, deflate Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Connection: keep-alive Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Content-Length: 0 Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Host: 10.222.0.57 Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Openstack-Api-Version: compute 2.92 Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Openstack-System-Scope: None Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: User-Agent: python-novaclient Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Auth-Token: gAAAAABjMTqeB2M-LeRy0p31k-tnWflBYai-iofRphhz8zY5rfdc6IHHBiBUtnQHujuUP8DppYk7PD-cwFeTSQFXMSzlw9SuwfHW0k1LZYOKfdjKzt2cXPkVGIRRx1OkhFtqUasJS87j11-oHcXt66NGz_5coGg8uxOMTExckye9hfQjNmoY6y4 Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Domain-Id: None Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Domain-Name: None Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Identity-Status: Confirmed Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Is-Admin-Project: True Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Domain-Id: default Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Domain-Name: Default Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Name: admin Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Role: admin,member,reader Sep 26 05:37:35.190502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Roles: admin,member,reader Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb1661fcfa594d16a5b5329ef20333a6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant: admin Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant-Name: admin Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User: admin Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Domain-Id: default Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Domain-Name: Default Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Id: 7236c9ce10b9442581cf096a5b4cddf9 Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Name: admin Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: method: > Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: exception: Flavor 42 could not be found. Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: action_args: {'id': '42'} Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:35.192029 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:35.194211 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:35.195430 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-07c48d71-8824-4c08-8627-e2116e04fcbb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:35.196630 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-07c48d71-8824-4c08-8627-e2116e04fcbb admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015305 Sep 26 05:37:35.196630 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Sep 26 05:37:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:36.446082 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-0b390cca-ec3c-4d03-8d80-a3e33b1bcd83 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:36.447111 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-0b390cca-ec3c-4d03-8d80-a3e33b1bcd83 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 26 05:37:36.447498 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:36.998731 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-f310deab-2d5c-470b-b661-ece752abc86e admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:37.003937 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.wsgi [None req-f310deab-2d5c-470b-b661-ece752abc86e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-f310deab-2d5c-470b-b661-ece752abc86e admin admin] Request method failure captured: Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Accept: application/json Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Accept-Encoding: gzip, deflate Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Connection: keep-alive Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Content-Length: 0 Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Host: 10.222.0.57 Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Openstack-Api-Version: compute 2.92 Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Openstack-System-Scope: None Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: User-Agent: python-novaclient Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Auth-Token: gAAAAABjMTqgIw6gHRBILbgNL-rXb2O_VRvRA_1eclJA9LUj7mEON1mtTvbFWrisPR5cywgBrNMsN2bZwoJr1txMw13etUGc0qO_06FerzwyuaCftFj0qCNePgr8Nds_LCZ_pDMo3zs6xWJ6OQXkc1BBnFCwkD9gNYrJfA2MAkD0iG2lJzOosQo Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Domain-Id: None Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Domain-Name: None Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Identity-Status: Confirmed Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Is-Admin-Project: True Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Domain-Id: default Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Domain-Name: Default Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Name: admin Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Role: admin,member,reader Sep 26 05:37:37.005498 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Roles: admin,member,reader Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb1661fcfa594d16a5b5329ef20333a6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant: admin Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant-Name: admin Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User: admin Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Domain-Id: default Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Domain-Name: Default Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Id: 7236c9ce10b9442581cf096a5b4cddf9 Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Name: admin Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: method: > Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: exception: Flavor 84 could not be found. Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: action_args: {'id': '84'} Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:37.007347 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:37.008308 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.009816 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-f310deab-2d5c-470b-b661-ece752abc86e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:37.011060 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-f310deab-2d5c-470b-b661-ece752abc86e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.425209 Sep 26 05:37:37.011060 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Sep 26 05:37:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:37.017244 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-afe505f2-913f-48e8-be57-8f9ab1fb871f admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:37.032037 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-afe505f2-913f-48e8-be57-8f9ab1fb871f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018504 Sep 26 05:37:37.032605 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Sep 26 05:37:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:37.042768 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-bb269bf7-da9b-420b-8866-f567f6961783 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:37.058930 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-bb269bf7-da9b-420b-8866-f567f6961783 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019737 Sep 26 05:37:37.059491 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Sep 26 05:37:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:37.069403 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-779e7cbc-d9f8-430c-bbe8-bb078b74937f admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:37.074897 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.wsgi [None req-779e7cbc-d9f8-430c-bbe8-bb078b74937f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-779e7cbc-d9f8-430c-bbe8-bb078b74937f admin admin] Request method failure captured: Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Accept: application/json Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Accept-Encoding: gzip, deflate Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Connection: keep-alive Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Content-Length: 0 Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Host: 10.222.0.57 Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Openstack-Api-Version: compute 2.92 Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Openstack-System-Scope: None Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: User-Agent: python-novaclient Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Auth-Token: gAAAAABjMTqgIw6gHRBILbgNL-rXb2O_VRvRA_1eclJA9LUj7mEON1mtTvbFWrisPR5cywgBrNMsN2bZwoJr1txMw13etUGc0qO_06FerzwyuaCftFj0qCNePgr8Nds_LCZ_pDMo3zs6xWJ6OQXkc1BBnFCwkD9gNYrJfA2MAkD0iG2lJzOosQo Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Domain-Id: None Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Domain-Name: None Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Identity-Status: Confirmed Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Is-Admin-Project: True Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Domain-Id: default Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Domain-Name: Default Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Name: admin Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Role: admin,member,reader Sep 26 05:37:37.076473 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Roles: admin,member,reader Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb1661fcfa594d16a5b5329ef20333a6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant: admin Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant-Name: admin Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User: admin Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Domain-Id: default Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Domain-Name: Default Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Id: 7236c9ce10b9442581cf096a5b4cddf9 Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Name: admin Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: method: > Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: exception: Flavor 84 could not be found. Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: action_args: {'id': '84'} Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:37.077994 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:37.078992 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:37.080312 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-779e7cbc-d9f8-430c-bbe8-bb078b74937f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:37.081572 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-779e7cbc-d9f8-430c-bbe8-bb078b74937f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012053 Sep 26 05:37:37.081572 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Mon Sep 26 05:37:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:38.345441 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-bb269bf7-da9b-420b-8866-f567f6961783 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:38.346459 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-bb269bf7-da9b-420b-8866-f567f6961783 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Sep 26 05:37:38.346849 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:38.918251 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-8a9128ad-4b44-464a-a2f2-b49f3f203bfe admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:38.925878 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.wsgi [None req-8a9128ad-4b44-464a-a2f2-b49f3f203bfe admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-8a9128ad-4b44-464a-a2f2-b49f3f203bfe admin admin] Request method failure captured: Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Accept: application/json Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Accept-Encoding: gzip, deflate Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Connection: keep-alive Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Content-Length: 0 Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Host: 10.222.0.57 Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Openstack-Api-Version: compute 2.92 Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Openstack-System-Scope: None Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: User-Agent: python-novaclient Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Auth-Token: gAAAAABjMTqiQDMjQGQULbmFg9rNyE1XXLOmB6koANA3-BxRrck5t04IygpNYIp_XMxFyC3r68g1gS2RFlh3Z66c40Hxqhf-OofvEQ4IxZcSjrzKbPU9JsPHeKP1_rqjRtCa_qzs4zg20q4XQYZZo39JsdARBiWovZAwtkqOijpHxkEWXaqLY6c Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Domain-Id: None Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Domain-Name: None Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Identity-Status: Confirmed Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Is-Admin-Project: True Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Domain-Id: default Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Domain-Name: Default Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Project-Name: admin Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Role: admin,member,reader Sep 26 05:37:38.928255 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Roles: admin,member,reader Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb1661fcfa594d16a5b5329ef20333a6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant: admin Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-Tenant-Name: admin Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User: admin Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Domain-Id: default Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Domain-Name: Default Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Id: 7236c9ce10b9442581cf096a5b4cddf9 Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: X-User-Name: admin Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: method: > Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: exception: Flavor 451 could not be found. Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: action_args: {'id': '451'} Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:38.930872 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:38.931869 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: ERROR nova.api.openstack.wsgi Sep 26 05:37:38.933194 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-8a9128ad-4b44-464a-a2f2-b49f3f203bfe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:38.935567 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-8a9128ad-4b44-464a-a2f2-b49f3f203bfe admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.451688 Sep 26 05:37:38.936144 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Sep 26 05:37:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 453 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:38.947191 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-29000138-0bdc-4783-b79e-638dc72db82b admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:38.966046 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-29000138-0bdc-4783-b79e-638dc72db82b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023430 Sep 26 05:37:38.966611 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Sep 26 05:37:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:38.981506 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:39.000613 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025115 Sep 26 05:37:39.001266 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Mon Sep 26 05:37:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:37:39.015777 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-ba2d4570-b55e-4b06-8c15-96ff78fc141f admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:39.021526 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.wsgi [None req-ba2d4570-b55e-4b06-8c15-96ff78fc141f admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-ba2d4570-b55e-4b06-8c15-96ff78fc141f admin admin] Request method failure captured: Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Accept: application/json Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Accept-Encoding: gzip, deflate Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Connection: keep-alive Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Content-Length: 0 Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Host: 10.222.0.57 Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Openstack-Api-Version: compute 2.92 Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Openstack-System-Scope: None Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: User-Agent: python-novaclient Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Auth-Token: gAAAAABjMTqiQDMjQGQULbmFg9rNyE1XXLOmB6koANA3-BxRrck5t04IygpNYIp_XMxFyC3r68g1gS2RFlh3Z66c40Hxqhf-OofvEQ4IxZcSjrzKbPU9JsPHeKP1_rqjRtCa_qzs4zg20q4XQYZZo39JsdARBiWovZAwtkqOijpHxkEWXaqLY6c Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Domain-Id: None Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Domain-Name: None Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Identity-Status: Confirmed Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Is-Admin-Project: True Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Domain-Id: default Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Domain-Name: Default Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Project-Name: admin Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Role: admin,member,reader Sep 26 05:37:39.023276 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Roles: admin,member,reader Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fb1661fcfa594d16a5b5329ef20333a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fb1661fcfa594d16a5b5329ef20333a6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant: admin Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant-Id: fb1661fcfa594d16a5b5329ef20333a6 Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-Tenant-Name: admin Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User: admin Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Domain-Id: default Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Domain-Name: Default Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Id: 7236c9ce10b9442581cf096a5b4cddf9 Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: X-User-Name: admin Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: method: > Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: exception: Flavor 451 could not be found. Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: action_args: {'id': '451'} Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:37:39.024867 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:39.025795 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: ERROR nova.api.openstack.wsgi Sep 26 05:37:39.027325 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-ba2d4570-b55e-4b06-8c15-96ff78fc141f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:37:39.028635 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-ba2d4570-b55e-4b06-8c15-96ff78fc141f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.015129 Sep 26 05:37:39.028635 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Sep 26 05:37:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:40.273322 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:40.274388 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 Sep 26 05:37:40.274805 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:40.827773 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-eec05679-fdbc-4124-b0b1-b07ac41f057d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:40.849485 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-eec05679-fdbc-4124-b0b1-b07ac41f057d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.438737 Sep 26 05:37:40.849967 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Sep 26 05:37:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:42.100373 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:42.101466 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 26 05:37:42.101861 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:42.779406 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-31511b18-36c2-4f03-8531-45866feb0aeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:42.800890 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-31511b18-36c2-4f03-8531-45866feb0aeb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.561010 Sep 26 05:37:42.801509 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Sep 26 05:37:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:44.056541 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:44.057605 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 26 05:37:44.057993 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:44.607357 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-4513cd3d-0916-4cd9-97b6-8913bbf7fe40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:44.630026 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-4513cd3d-0916-4cd9-97b6-8913bbf7fe40 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.436971 Sep 26 05:37:44.630553 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Sep 26 05:37:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:45.867917 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:45.868929 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 26 05:37:45.869382 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:46.418732 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-6274081c-99c0-4296-815f-0ab9622ced37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:37:46.438810 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-6274081c-99c0-4296-815f-0ab9622ced37 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.430667 Sep 26 05:37:46.439366 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Mon Sep 26 05:37:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:37:47.685611 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:47.686618 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 26 05:37:47.686978 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:37:48.250985 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-58e7f95a-5bdc-41fc-a3e3-cf641dae42e0 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:37:48.271463 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-58e7f95a-5bdc-41fc-a3e3-cf641dae42e0 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.448658 Sep 26 05:37:48.272008 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Mon Sep 26 05:37:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:38:45.766338 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:45.767248 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-013ae70e-37f2-4f55-a3d4-5ceb124cd67a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 26 05:38:45.767661 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 931 bytes} [Mon Sep 26 05:38:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:38:45.778712 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:46.182042 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-05596895-49f8-4b63-bdc6-c323a6046257 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:46.202793 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-05596895-49f8-4b63-bdc6-c323a6046257 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428644 Sep 26 05:38:46.203343 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1292 bytes} [Mon Sep 26 05:38:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:38:46.225037 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_api:SELECT=14 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:46.228858 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-feafeeec-d60f-475f-947b-cd6c553a4cae admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:46.236699 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-feafeeec-d60f-475f-947b-cd6c553a4cae admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013237 Sep 26 05:38:46.237271 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1283 bytes} [Mon Sep 26 05:38:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:46.249480 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-87a51063-091c-44ad-965f-2342fe8fff83 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:46.256932 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-87a51063-091c-44ad-965f-2342fe8fff83 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011108 Sep 26 05:38:46.257491 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1286 bytes} [Mon Sep 26 05:38:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:46.269332 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:46.276884 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011086 Sep 26 05:38:46.277344 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1286 bytes} [Mon Sep 26 05:38:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:38:46.289122 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-bf5b6bc2-8fa4-491b-be30-3e591c11585e admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:38:46.296535 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-bf5b6bc2-8fa4-491b-be30-3e591c11585e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011057 Sep 26 05:38:46.297056 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1283 bytes} [Mon Sep 26 05:38:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:42:07.667665 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:07.668668 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 26 05:42:07.669054 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:42:07.807204 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_api:SELECT=6 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:07.969830 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:07.974557 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:07.975025 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:07.975438 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:07.976135 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:07.976566 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:07.976970 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:08.007673 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-0461d9d0-880a-4801-8ef6-6ddcc3bc802b admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.202108 Sep 26 05:42:08.008221 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Sep 26 05:42:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:42:09.098168 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:09.099162 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 26 05:42:09.099585 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:42:09.292452 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:09.295896 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:09.296372 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:09.296857 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:09.297605 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:09.298045 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:09.298459 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:09.318088 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-72c080aa-d863-4c1e-a0aa-38053f19b675 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077650 Sep 26 05:42:09.318688 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Sep 26 05:42:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:42:20.860487 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:20.861524 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 26 05:42:20.861913 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:42:21.008039 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_cell0:SELECT=4 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:21.008762 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_cell1:SELECT=4 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:21.009482 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG dbcounter [-] [112185] Writing DB stats nova_api:SELECT=8 {{(pid=112185) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:21.059915 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:21.063400 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:21.063879 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:21.064304 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:21.065028 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:21.065502 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:21.065914 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:21.091275 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-d043f9d1-395f-4fc7-b525-27a2264f5082 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.090398 Sep 26 05:42:21.092521 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Sep 26 05:42:20 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:42:22.176041 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG nova.api.openstack.wsgi [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] Calling method '>' {{(pid=112184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:22.177048 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: INFO nova.api.openstack.requestlog [None req-73c83476-ff46-47d7-b22c-cf892b0bdf91 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 26 05:42:22.177476 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: [pid: 112184|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Mon Sep 26 05:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:42:22.381912 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG nova.api.openstack.wsgi [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] Calling method '>' {{(pid=112185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:42:22.385350 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:22.385837 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:22.386258 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:22.386956 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:42:22.387385 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:42:22.387902 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: DEBUG oslo_concurrency.lockutils [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:42:22.410115 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: INFO nova.api.openstack.requestlog [None req-103518ff-2a71-4b7b-b968-cc2fe7081560 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.089552 Sep 26 05:42:22.410685 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: [pid: 112185|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Mon Sep 26 05:42:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:43:20.789435 dv-cinder-836083-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 26 05:43:20.790099 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: Mon Sep 26 05:43:20 2022 - graceful shutdown triggered... Sep 26 05:43:20.790548 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: Gracefully killing worker 1 (pid: 112184)... Sep 26 05:43:20.790931 dv-cinder-836083-14-iscsi devstack@n-api.service[112185]: Gracefully killing worker 2 (pid: 112185)... Sep 26 05:43:20.922554 dv-cinder-836083-14-iscsi devstack@n-api.service[112184]: DEBUG dbcounter [-] [112184] Writing DB stats nova_api:SELECT=4 {{(pid=112184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:43:21.790945 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: worker 1 buried after 1 seconds Sep 26 05:43:21.790945 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: worker 2 buried after 1 seconds Sep 26 05:43:21.790945 dv-cinder-836083-14-iscsi devstack@n-api.service[112183]: goodbye to uWSGI. Sep 26 05:43:21.792605 dv-cinder-836083-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 26 05:43:21.793209 dv-cinder-836083-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 26 05:43:21.796049 dv-cinder-836083-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 05:43:21.807443 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 05:43:21 2022] *** Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: nodename: dv-cinder-836083-14-iscsi Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: machine: x86_64 Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: clock source: unix Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: pcre jit disabled Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: detected number of CPU cores: 4 Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: current working directory: / Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: detected binary path: /usr/bin/uwsgi-core Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: your processes number limit is 47680 Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: your memory page size is 4096 bytes Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: detected max file descriptor number: 2048 Sep 26 05:43:21.810175 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: lock engine: pthread robust mutexes Sep 26 05:43:21.811140 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: thunder lock: enabled Sep 26 05:43:21.811140 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 05:43:21.811140 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 05:43:21.850519 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: Python main interpreter initialized at 0x5560392319c0 Sep 26 05:43:21.850519 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: python threads support enabled Sep 26 05:43:21.850519 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: your server socket listen backlog is limited to 100 connections Sep 26 05:43:21.850519 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: your mercy for graceful operations on workers is 90 seconds Sep 26 05:43:21.851002 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 05:43:21.851002 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: *** Operational MODE: preforking *** Sep 26 05:43:21.851239 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: *** uWSGI is running in multiple interpreter mode *** Sep 26 05:43:21.851239 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: spawned uWSGI master process (pid: 127252) Sep 26 05:43:21.851471 dv-cinder-836083-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 05:43:21.852016 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: spawned uWSGI worker 1 (pid: 127274, cores: 1) Sep 26 05:43:21.852537 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: spawned uWSGI worker 2 (pid: 127275, cores: 1) Sep 26 05:43:21.852825 dv-cinder-836083-14-iscsi devstack@n-api.service[127252]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 05:43:22.507307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:43:22.509755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 05:43:23.651538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:43:23.651538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: from cryptography.utils import int_from_bytes Sep 26 05:43:23.652374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:43:23.652374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: from cryptography.utils import int_from_bytes Sep 26 05:43:23.654567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:43:23.654567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: from cryptography.utils import int_from_bytes Sep 26 05:43:23.655052 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:43:23.655052 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: from cryptography.utils import int_from_bytes Sep 26 05:43:26.072247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:43:26.072945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:43:26.073071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:43:26.073466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:43:26.073721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:43:26.074110 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.074437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.074757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.075075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.075408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.075718 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.076042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.076358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.076680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.076938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.077280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.077782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-14-iscsi {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.078102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.078410 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.078726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.079047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.079350 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.079669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.079972 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.080477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.082011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.082011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.082011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.082011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.082357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.082531 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.082834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.083152 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.083466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.083788 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.084187 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-14-iscsi {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.084508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.084831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.085147 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.085585 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.085895 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.086202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.086519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.086838 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.087142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.087878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.088164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.088480 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.088796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.089094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.089441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.090030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.090350 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.090658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.090964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.091216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.091528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.091857 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.092175 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.092497 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.092745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.092993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.093343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.093665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.093976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.094280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.094584 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.094888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.095192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.095546 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.095803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.096104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.096419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.096745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.097084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.097447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.097769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.098179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.098447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.098737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.099075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.099399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.099719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.100030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.100348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.100655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.100961 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.101291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.101619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.101961 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.102262 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.102510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.102813 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.103116 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.103441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.103743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.104053 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.104356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.104657 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.104962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.105296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.105604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.105909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.106216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.106523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.106824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.107131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.107439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.107731 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.108052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.108377 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.108683 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.108991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.109324 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.109633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.109954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.110262 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.110568 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.110768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:43:26.111198 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.111287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:43:26.111379 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.111479 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.111565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:43:26.111789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.111904 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:43:26.112094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.112207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:43:26.112405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.112521 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.112756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.112922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.113060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.113271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.113459 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.113597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.113691 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.113932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.114025 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.114246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.114365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.114568 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.114669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.114872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.114974 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.115173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.115273 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.115452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.115544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.115765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.115855 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.116067 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.116217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836083-14-iscsi {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.116368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.116554 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.116666 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.116864 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.116991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.117203 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.117313 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.117528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.117633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.117839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.117938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.118179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.118273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.118472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.118586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.118855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.118976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.119197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.119291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.119511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.119620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.119844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.119947 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.120185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.120280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.120488 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.120591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.120800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.120900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.121113 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.121217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.121445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.121538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.121771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.121888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.122081 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.122167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.122397 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.122521 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836083-14-iscsi {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.122713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.123922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.124080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.124226 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.124356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.124498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.124660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.124796 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.124933 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.125072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.125364 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.125502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.125640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.125777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.125910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.126045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.126196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.126349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.126484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.126619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.126776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.126934 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.127061 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.127185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.127317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.127451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.127594 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.127744 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.127877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.128014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.128132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.128132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.128132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.128624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.128772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.128914 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.129062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.129959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.129959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.130267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.130267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.130787 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.130787 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.131454 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.131608 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.132527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.132691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.132855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.133005 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.133173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.133173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.133479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.133479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.133771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.133929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.134074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.134214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.134361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.134520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.134670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.134819 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.134960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.135100 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.135246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.135394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.135534 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.135684 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.135824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.135962 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.136101 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.136249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.136412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.136567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.136708 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.136847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.136994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.137166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.137326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.137477 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.137624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.137774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.137922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.138070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.138219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.138369 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.138517 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.138517 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.138784 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.138937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.139086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.139235 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.139374 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.139512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.139652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.139792 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.139946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.140104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.140245 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.140391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.140531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.140683 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.140829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.140971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.141283 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.141432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.141432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.141713 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.141946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.142093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.142252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.142401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.142558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.142789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.142943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.143084 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.143084 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.143349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.143499 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.143661 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.143812 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.144016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.144016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.144324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.144473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.144614 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.144614 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.144910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.145059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.145241 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.145395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.145543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.145693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.145842 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.145983 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.146139 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.146139 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.146430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.146581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.146721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.146861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.147007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.147007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.147287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.147442 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.147585 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.147724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.147863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.148002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.148170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.148317 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.148465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.148615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.148755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.148755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.149040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.149210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.149366 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.149366 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.149648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.149648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.149942 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.150091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.150249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.150399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.150539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.150679 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.150826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.150973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.151126 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.151402 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.151548 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.151688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.151828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.152066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.152228 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.152378 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.152519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.152670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.152835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.153076 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.153263 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.153409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.153565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.153710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.153858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.153858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.154176 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.154340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.154482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.154632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.154780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.155096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.155248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.155408 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.156420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.157549 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.157728 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.157891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.158034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.158302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.158453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.158594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.158743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.158966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.159125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.159268 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.159407 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.159573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.159723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.159873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.160022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.160163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.160314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.160463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.160621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.160772 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.160913 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.161060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:43:26.161275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.161633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.161797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.161948 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.162125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.162382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.162550 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.162691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.162842 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.162991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.163277 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.163494 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.163649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.163807 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.163964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.164113 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.164254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.164395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.164542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.164542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.164833 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.164973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.165124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.165286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.165425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.165577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.165769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.165922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.166077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.166219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.166358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.166506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.166658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.166846 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.166992 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.167142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.167305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.167466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.167607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.167746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.167922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.167922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.168219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.168375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.168526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.168526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.168807 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.168955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.169109 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.169285 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.169438 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.169587 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.169739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.169887 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.170042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.170193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.170404 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.170565 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.170747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.170894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.171062 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.171213 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.171355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.171523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.171851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.172087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.172245 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.172530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.172679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.172819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.172985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.173322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.173555 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.173713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.173873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174017 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174580 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.174999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.175266 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.175436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.175615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.175615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.175895 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.175895 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.176259 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.176405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.176555 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.176755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.176905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.177094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.177276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.177428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.177570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.177733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.177875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.178026 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.178206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.178355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.178518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.178668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.178841 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.178996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.179146 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.179307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.179465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.179610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.179803 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.179945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.180107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.180252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.180400 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.180540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.180690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.180831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.180977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.181118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.181296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.181436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.181588 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.181747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.182025 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.182180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.182321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.182469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.182711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.182857 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.182998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.183145 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.183293 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.183453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.183691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.183854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.183996 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.184143 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.184285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.184434 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.184582 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.184741 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.184883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.185023 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.185232 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.185403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.185552 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.185552 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.185825 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.185967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.186108 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.186256 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.186403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.186544 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.186692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.186832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.186982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.187123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.187286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.187428 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.187576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.187724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.187873 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.188013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.188152 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.188292 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.188447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.188595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.188745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.188892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.189034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.189200 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.189362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.189511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.189658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.189799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.189937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.190086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.190234 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.190382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.190530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.190670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.190839 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.190993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.191151 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.191293 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.191440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.191590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.191730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.191730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.192136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.192282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.192430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.192570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.192727 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.192951 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.193108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.193294 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.193437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.193437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.193737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.193737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.194154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.194316 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.194471 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.194626 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.194786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.194934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.195979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.196274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.196435 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.196584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.196739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.196885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.197037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.197224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.197387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.197534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.197680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.197835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.197990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.198136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.198289 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.198453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.198674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.198833 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.198980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.199127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.199293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.199447 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.199602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.200460 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.200620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.200777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.200940 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.201097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.201328 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.201477 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.201641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.201870 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.202212 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.202393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.202551 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.202708 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.202856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.203107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.203269 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.203425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.203573 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.203731 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.203893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.203893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.204314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.204484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.204632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.204779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.204939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.205094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.205264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.205421 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.205576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.205730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.205888 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.206044 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.206192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.206338 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.206552 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.206726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.207744 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.207926 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.208082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.208229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.208377 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.208532 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.208688 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.208845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.208995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.209168 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.209323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.209493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.209650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.209798 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.209944 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.210099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.210253 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.210409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.210556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.210711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.210876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.211032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.211237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.211401 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.211568 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.211716 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.211871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.212018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.212665 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.212834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.212990 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.213290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.213460 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.213609 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.213786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.213945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.214104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.214367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.214523 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.214680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.214837 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.214985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.215131 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.215278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.215424 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.215579 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.215735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.215884 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.216039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.216197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.216354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.216509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.216670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.216819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.216973 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.217128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.217311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.217474 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.217622 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.217768 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.217921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.218075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.218240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.218409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.218557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.218711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.218859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.219006 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.219152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.219307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.219463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.219611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.219758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.219903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.220049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.220224 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.220372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.220592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.220743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.220898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221056 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221406 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221688 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.221986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222293 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222379 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222480 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222905 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.222988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223293 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223534 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223616 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.223946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224019 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224091 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224408 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224481 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224561 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224868 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.224942 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225022 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225483 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225626 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225781 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225926 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.225997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226299 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226370 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226758 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.226997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227604 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227691 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227784 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.227979 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228594 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.228941 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229227 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229335 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229424 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.229939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230309 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230402 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230491 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230583 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230853 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.230949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231129 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231308 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231403 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231730 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231911 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.231997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232461 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232621 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232694 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232765 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.232990 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233259 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233429 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.233805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.239918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.239918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.240783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.240905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241234 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241549 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.241990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.242720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243516 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243661 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.243965 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.244045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.244125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.244250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.244344 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.244432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.244509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.244509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.247588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.247588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.247796 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.247931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248186 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248557 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.248935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.249804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.250071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.250208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.250373 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.250576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.250853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.250968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.251167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.251278 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.251470 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.251615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.251883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.252070 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253164 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253471 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253543 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253830 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.253980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.254654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.254755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.254755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.254906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.254978 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.255252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.255353 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.255553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.255652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.255833 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.255978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.256220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.256382 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.256532 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.256677 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.256839 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.256986 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.257170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.257325 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.257483 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.257732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.257887 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.258090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.258404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.258561 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.258717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.258864 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.259010 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.259156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.259312 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.259460 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.259618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.259772 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.259920 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.260094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.260094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.260468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.260468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.260756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.260912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.261067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.261288 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.261439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.261593 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.261759 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.261907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.262063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.262210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.262371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.262519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.262666 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.262813 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.262972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.263127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.263290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.263437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.263594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.263751 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.263906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.264061 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.264215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.264366 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.264513 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.264670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.264826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.264973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.265120 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.265301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.265301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.265613 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.265768 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.265917 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.266070 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.266246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.266473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.266840 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.266996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.267145 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.267307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.267455 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.267615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.267885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.268082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.268243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.268477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.268630 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.268793 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.268998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.269270 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.269437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.269594 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.269742 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.269904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.269904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.270206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.270450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.270605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.270765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.270765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.270765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.271188 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.271350 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.271506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.271667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.271667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.271976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.272141 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.272296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.272442 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.272599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.272746 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.272900 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.273048 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.273215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.273368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.273527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.273682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.273830 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.273986 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.274143 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.274312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.274469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.274617 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.274782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.275017 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.275170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.275327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.275542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.275704 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.275910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.276088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.276245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.276538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.276701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.276856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.277068 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.277282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.277431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.277639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.277973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.278186 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.278341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.278505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.278805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.278979 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.279138 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.279287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.279442 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.279596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.279753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.279901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.280048 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.280195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.280342 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.280600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.280764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.280764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.281071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.281250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.281400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.281547 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.281712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.281868 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.282016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.282219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.282526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.282742 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.282897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.283075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.283238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.283407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.283556 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.283713 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.283861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.284009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.284161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.284473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.284667 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.284846 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.285004 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.285218 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.285384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.285552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.285552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.285918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.286076 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.286232 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.286387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.286543 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.286808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.286972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.287122 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.287269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.287416 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.287567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.287743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.287892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.288059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.288339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.288493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.288641 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.288816 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.289038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.289206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.289371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.289521 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.289668 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.289910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.289910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.290211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.290367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.290523 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.290779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.290934 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.291082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.291237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.291391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.291391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.291684 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.291833 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.291987 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.292153 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.292302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.292302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.292604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.292760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.292909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.293064 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.293260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.293411 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.293567 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.293723 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.293877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.294037 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.294184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.294344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.294499 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.294664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.294813 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.294970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.295124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.295280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.295435 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.295584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.295730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.295730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.296027 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.296188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.296335 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.296482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.296637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.296804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.297038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.297234 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.297396 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.297544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.297698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.297896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.298063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.298231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.298502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.298655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.298811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.298966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.299217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.299379 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.299528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.299684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.299832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.299987 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.300171 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.300449 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.300607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.300775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.300996 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.301384 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.301545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.301703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.301703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.301999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.302146 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.302309 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.302458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.302458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.302790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.302956 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.303105 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.303266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.303415 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.303561 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.303718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.303874 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.304036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.304201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.304358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.304358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.304665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.304824 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.304985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.305160 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.305325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.305482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.305630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.305785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.305947 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.306094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.306242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.306242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.306523 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.306687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.306849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.307016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.307252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.307415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.307573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.307736 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.307736 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.308031 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.308180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.308327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.308605 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.308785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.308942 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.309090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.309306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.309459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.309614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.309778 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.309935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.310082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.310228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.310228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.310515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.310672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.310832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.311004 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.311236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.311406 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.311672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.311828 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.311991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.312140 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.312140 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.312427 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.312589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.312751 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.312908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.313075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.313303 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.313452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.313616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.313616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.313913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.314068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.314224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.314380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.314528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.314699 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.314848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.315002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.315002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.315302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.315450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.315596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.315743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.315932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.316080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.316241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.316467 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.316655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.316805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.316805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.317095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.317295 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.317528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.317690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.317839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.317993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.318151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.318299 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.318453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.318660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.318920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.319075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.319232 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.319392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.319539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.319686 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.319841 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.319997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.320230 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.320380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.320528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.320675 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.320675 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.320983 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.321156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.321431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.321611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.321839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.321992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.322156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.322309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.322464 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.322618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.322618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.322915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.323072 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.323220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.323378 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.323525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.323679 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.323835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.323991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.324146 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.324303 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.324456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.324621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.324785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.324934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.325089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.325335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.325485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.325633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.325792 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.325941 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.326087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.326234 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.326395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.326554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.326709 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.326857 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.327003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.327164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.327164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.327468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.327738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.327895 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.328044 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.328190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.328337 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.328493 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.328688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.328688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.329091 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.329267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.329445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.329602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.329750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.329897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.330044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.330198 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.330354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.330502 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.330651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.330806 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.330806 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.331102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.331263 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.331473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.331734 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.331992 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.332148 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:43:26.332307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.332307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.332307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.332307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.332307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.333001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.333001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.333001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.333536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.333879 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.334241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.334566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.334902 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.335243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.335558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.336017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.336360 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.336676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.336988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.337724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.338032 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.338342 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.338652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.338970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.339305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.339590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.339907 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.340368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.340707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.341020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.341580 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.341883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.342201 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.342518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.342829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.343141 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.343451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.343769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.344078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.344507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.344811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.345128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.345518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.345963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.346381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.346723 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.347063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.347379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.347707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.348019 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.348339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.348659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.348978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.349480 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.349681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.350276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.352995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.352995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.352995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.352995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.352995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.352995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.353952 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.353952 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.353952 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.354383 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.354594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.354790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.355111 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.355429 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.355747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.356094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.356508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.356834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.357199 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.357485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.357802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.358117 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.358437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.358788 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.359114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.359440 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.359764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.360088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.360405 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.360720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.361039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.361396 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.361929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.362269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.362597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.363112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.363465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.363786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.364113 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.364444 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.364765 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.365089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.365442 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.365759 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.366086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.366514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.366857 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.367204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.367540 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.367870 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.368193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.368486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.368796 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.369201 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.369459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.369782 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.370077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.370387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.370701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.371009 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.371319 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.371693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.372101 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.372426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.372741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.373256 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.373437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.373716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.374421 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.374733 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.375238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.375553 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.375865 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.376175 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.376600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.376916 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.377281 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.377619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.377939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.378284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.378607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.378977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.379240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.379570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.379951 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.380213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.380527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.380866 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.381211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.381531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.382065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.382380 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.382700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.383014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.383357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.383688 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.383998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.384330 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.384654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.384976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.385321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.385638 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.385971 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.386287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.386635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.386948 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.387327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.387599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.387919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.388234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.388548 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.388872 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.389433 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.389607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.389915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.390280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.390729 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.391152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.391514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.391834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.392083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO dbcounter [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Registered counter for database nova_api Sep 26 05:43:26.392275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.392562 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.392884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.393290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.393605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:43:26.393995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:43:26.413708 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_db.sqlalchemy.engines [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.420414 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writer thread running {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.455465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO dbcounter [None req-36897979-0799-4211-ad26-221281286104 None None] Registered counter for database nova_api Sep 26 05:43:26.476241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_db.sqlalchemy.engines [None req-36897979-0799-4211-ad26-221281286104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.476722 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.context [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efcbfa72-6b16-406c-b5c5-ca53c6356a25(cell1) {{(pid=127275) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:43:26.480834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:43:26.481341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:43:26.482907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:43:26.483076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writer thread running {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.483643 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:43:26.484086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:43:26.486147 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:43:26.488241 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO dbcounter [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Registered counter for database nova_cell0 Sep 26 05:43:26.492323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO dbcounter [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Registered counter for database nova_cell1 Sep 26 05:43:26.500107 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_db.sqlalchemy.engines [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.501976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_db.sqlalchemy.engines [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.508362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writer thread running {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.509662 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writer thread running {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.540187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.context [None req-36897979-0799-4211-ad26-221281286104 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),efcbfa72-6b16-406c-b5c5-ca53c6356a25(cell1) {{(pid=127274) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 05:43:26.544288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36897979-0799-4211-ad26-221281286104 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:43:26.544761 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36897979-0799-4211-ad26-221281286104 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:43:26.546379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36897979-0799-4211-ad26-221281286104 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:43:26.547123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36897979-0799-4211-ad26-221281286104 None None] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:43:26.547570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36897979-0799-4211-ad26-221281286104 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:43:26.549596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36897979-0799-4211-ad26-221281286104 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:43:26.551721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO dbcounter [None req-36897979-0799-4211-ad26-221281286104 None None] Registered counter for database nova_cell0 Sep 26 05:43:26.555893 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO dbcounter [None req-36897979-0799-4211-ad26-221281286104 None None] Registered counter for database nova_cell1 Sep 26 05:43:26.563312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_db.sqlalchemy.engines [None req-36897979-0799-4211-ad26-221281286104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.566901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_db.sqlalchemy.engines [None req-36897979-0799-4211-ad26-221281286104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.570362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writer thread running {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.576637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writer thread running {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.655448 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO dbcounter [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Registered counter for database nova_cell0 Sep 26 05:43:26.663440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_db.sqlalchemy.engines [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.668370 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writer thread running {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.721478 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO dbcounter [None req-36897979-0799-4211-ad26-221281286104 None None] Registered counter for database nova_cell0 Sep 26 05:43:26.728750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_db.sqlalchemy.engines [None req-36897979-0799-4211-ad26-221281286104 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:43:26.734071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writer thread running {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:43:26.984399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: WARNING keystonemiddleware.auth_token [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:43:26.992367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: WARNING keystonemiddleware.auth_token [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:43:27.051524 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: WARNING keystonemiddleware.auth_token [None req-36897979-0799-4211-ad26-221281286104 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:43:27.058908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: WARNING keystonemiddleware.auth_token [None req-36897979-0799-4211-ad26-221281286104 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:43:27.340064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: WARNING keystonemiddleware.auth_token [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:43:27.346310 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: WARNING keystonemiddleware.auth_token [None req-1aaca99f-e0d9-4328-9b92-925bd7f16663 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:43:27.351841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560392319c0 pid: 127275 (default app) Sep 26 05:43:27.407676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: WARNING keystonemiddleware.auth_token [None req-36897979-0799-4211-ad26-221281286104 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 05:43:27.413849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: WARNING keystonemiddleware.auth_token [None req-36897979-0799-4211-ad26-221281286104 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 05:43:27.419117 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560392319c0 pid: 127274 (default app) Sep 26 05:44:03.433260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:03.434404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:03.438052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:03.441263 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:04.947101 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5427b4a1-e69e-44d3-8ed9-803376c1e268 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Action: 'create', calling method: .version_select at 0x7f1e5f47a430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1568215904", "metadata": {"Type": "work"}}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:06.855284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5427b4a1-e69e-44d3-8ed9-803376c1e268 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.445837 Sep 26 05:44:06.856003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Sep 26 05:44:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3448 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 05:44:06.873084 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:06.873989 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:06.874706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:06.875922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:07.552252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-83969229-fd8f-421f-9eed-ce65a153ffdd tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Calling method '.version_select at 0x7f1e5f52ff70>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:08.224243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-83969229-fd8f-421f-9eed-ce65a153ffdd tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f" status: 200 len: 353 microversion: 2.1 time: 1.356264 Sep 26 05:44:08.226286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 1/2] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:44:06 2022] GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f => generated 353 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:44:09.240737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f795fbd8-4c21-4767-ad3e-d9d024477e92 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Calling method '.version_select at 0x7f1e5f34e310>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:09.378392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f795fbd8-4c21-4767-ad3e-d9d024477e92 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f" status: 200 len: 354 microversion: 2.1 time: 0.142164 Sep 26 05:44:09.378964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:44:09 2022] GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:44:09.410399 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2ba2f408-9615-496f-aa0a-58f738029b95 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Calling method '.version_select at 0x7f1e5f339310>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:09.716304 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2ba2f408-9615-496f-aa0a-58f738029b95 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f" status: 200 len: 354 microversion: 2.1 time: 0.326807 Sep 26 05:44:09.717292 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:44:09 2022] GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f => generated 354 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:44:09.740689 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0e92ce05-5715-4439-a990-7f9e2ef84868 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Calling method '.version_select at 0x7f1e5f34ea60>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:09.920273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0e92ce05-5715-4439-a990-7f9e2ef84868 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f" status: 202 len: 0 microversion: 2.1 time: 0.185961 Sep 26 05:44:09.921188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 3/5] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:44:09 2022] DELETE /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:44:09.930932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f0c4b917-4aef-425d-b084-d7aad3c76ead tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Calling method '.version_select at 0x7f1e5f3399d0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:10.022300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f0c4b917-4aef-425d-b084-d7aad3c76ead tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f" status: 200 len: 353 microversion: 2.1 time: 0.096582 Sep 26 05:44:10.024945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:44:09 2022] GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:44:11.041339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8d5e833e-617e-44a6-89bf-751cc53f48f8 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Calling method '.version_select at 0x7f1e5f35b160>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:11.103850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-8d5e833e-617e-44a6-89bf-751cc53f48f8 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] HTTP exception thrown: Volume e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f could not be found. Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8d5e833e-617e-44a6-89bf-751cc53f48f8 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Request method failure captured: Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f HTTP/1.1 Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTwjsEWE5kdxJtV8hVR_S_KcDP-nMt-_B-Okm4I3ZkXI7NJWhYJEqlVriTvpU12ziidEuSNNLGEL_xxTbiiO_z1U2WFwZ7OooXxsuAW2nY__GSedR4SOuhb6WkHkzv-riu5fQagVpIsXdI7sh_qr5dtiBA4svxiH2iF7F5OAnz9pPVU Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 9f1cfa2fa11a49268ed10b8b0bb21f80 Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesGetTestJSON-1660318736 Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:44:11.109450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9f1cfa2fa11a49268ed10b8b0bb21f80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9f1cfa2fa11a49268ed10b8b0bb21f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9f1cfa2fa11a49268ed10b8b0bb21f80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9f1cfa2fa11a49268ed10b8b0bb21f80", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesGetTestJSON-1660318736 Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 9f1cfa2fa11a49268ed10b8b0bb21f80 Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesGetTestJSON-1660318736 Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesGetTestJSON-1660318736-project Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 7d1d25a5745b49b383a77d48ab5ef400 Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesGetTestJSON-1660318736-project Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Volume e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f could not be found. Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f'} Sep 26 05:44:11.110547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f could not be found. (HTTP 404) (Request-ID: req-2f651116-5148-402c-a32d-dd8128c7450e) Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:44:11.111280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:44:11.112496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f could not be found. Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:44:11.113466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f could not be found. Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f could not be found. Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8d5e833e-617e-44a6-89bf-751cc53f48f8 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] Returning 404 to user: Volume e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:44:11.114523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8d5e833e-617e-44a6-89bf-751cc53f48f8 tempest-VolumesGetTestJSON-1660318736 tempest-VolumesGetTestJSON-1660318736-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f" status: 404 len: 109 microversion: 2.1 time: 0.075011 Sep 26 05:44:11.115620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:44:11 2022] GET /compute/v2.1/os-volumes/e7404aa2-79a6-4aa6-bcbb-f3989d8bc04f => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:44:15.899455 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-680640433", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:16.142310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] validate_networks() for [('bdedc4e6-9308-457c-af01-ae4f7a8e4d99', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:44:18.840207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:44:18.840803 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:44:18.841401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:44:18.842000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:44:18.842572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:44:18.925452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:18.928497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:18.930018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:18.933516 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:18.936777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:18.937449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:19.038693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:19.051700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for user 342ce12282264d40b2f2bb6f1fc6ba25 and project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:19.104125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:44:19.107634 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:44:19.308208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c7dbe8f7-09d7-4705-807b-f348d7f98bb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.865984 Sep 26 05:44:19.320401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 4/8] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:44:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:44:19.325178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ab722a29-80ce-45fa-87f7-1cd92581de9b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:19.327252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ab722a29-80ce-45fa-87f7-1cd92581de9b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:19.968383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ab722a29-80ce-45fa-87f7-1cd92581de9b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:20.000141 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ab722a29-80ce-45fa-87f7-1cd92581de9b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1221 microversion: 2.1 time: 0.682429 Sep 26 05:44:20.014602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:19 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1221 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:20.348082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2012468020", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:20.509710 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] validate_networks() for [('bdedc4e6-9308-457c-af01-ae4f7a8e4d99', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:44:21.878799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:44:21.881105 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:44:21.882220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:44:21.883339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:44:21.884388 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:44:21.985943 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:21.989563 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:21.990148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:21.990963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:21.991428 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:21.991849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:22.077021 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:22.099534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for user 342ce12282264d40b2f2bb6f1fc6ba25 and project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:22.150167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:44:22.178274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:44:22.410609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-45c1aad6-4ae9-422a-815a-cafd70904c21 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.067882 Sep 26 05:44:22.414325 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 5/10] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:44:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:44:22.438817 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8bfeea95-cfed-4269-8fde-d89572f69ffb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:22.440363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8bfeea95-cfed-4269-8fde-d89572f69ffb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:22.690432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8bfeea95-cfed-4269-8fde-d89572f69ffb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:22.726474 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8bfeea95-cfed-4269-8fde-d89572f69ffb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1222 microversion: 2.1 time: 0.293498 Sep 26 05:44:22.727649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 6/11] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:22 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1222 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:23.323610 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-57963686-4e1a-4ae0-8eab-79efa43d947e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'create', calling method: .version_select at 0x7f1e5e9ee160>, body: {"keypair": {"name": "tempest-keypair-455244803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbwbgHguQdDbi1lEwAannY1TBna9iqReFekSAJ1nFy+5GsRm9xiY2q3fsWlt2MymwvEm+TBiTjwCmVpJAJrGBuyJzqcHSMoSMGOsfVk/2hYuo6Gm4RREo3Asocczt9xbQ=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:23.399946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-57963686-4e1a-4ae0-8eab-79efa43d947e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:23.408497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-57963686-4e1a-4ae0-8eab-79efa43d947e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for user 8c26eec9a5e841f8b760cc8cef309b18 and project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:23.496755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-57963686-4e1a-4ae0-8eab-79efa43d947e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.543224 Sep 26 05:44:23.498990 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 6/12] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:44:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:44:23.790804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c0a07f51-77eb-46dd-994e-d3029932461a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:23.796396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c0a07f51-77eb-46dd-994e-d3029932461a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:23.989872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c0a07f51-77eb-46dd-994e-d3029932461a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:24.037818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c0a07f51-77eb-46dd-994e-d3029932461a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1222 microversion: 2.1 time: 0.261304 Sep 26 05:44:24.042444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:23 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1222 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:25.080921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:25.082242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:25.113723 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:25.115300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:25.116681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:25.118597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:25.119729 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:25.120745 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:26.064844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:26.133766 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cd5ed33d-c085-49d2-8a2e-98ac82eb5d6d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1226 microversion: 2.1 time: 1.054450 Sep 26 05:44:26.149650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 7/14] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:25 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1226 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:26.309563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-14f1fee2-2eda-4854-86ef-3a2d8f1568a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'create', calling method: .version_select at 0x7f1e5f28ca60>, body: {"keypair": {"name": "tempest-keypair-1801855020", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER1XPy+MO6fRA+/quP57YZTLkEVNeb10ebR5Pty+Zey4dpewkg0xCw59v3XmkKNeMeg/0tZfnKUCgPTpf8EpPgfmHRcG327VOkZkifwNzm5+3/DHaOCdMWc867k2yq+Bg=="}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:26.396668 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4b98ef13-d754-48c2-a357-f45599edea34 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: .version_select at 0x7f1e5e98a820>, body: {"keypair": {"name": "tempest-keypair-1532414122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0uvUUX2cVFORSoCDa2gIPiQus9oNflmKKD2XFY8PwmLFHSuU/a7iWVzeTY9ajQ9ZH57HlzsW6yH8APff9aCh7KCsZ7sktoliXBNGJK9s2B+IAx4yT2ck8aYUTRaQwXDg=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:26.480897 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-4b98ef13-d754-48c2-a357-f45599edea34 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:26.511485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-4b98ef13-d754-48c2-a357-f45599edea34 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:26.586038 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-14f1fee2-2eda-4854-86ef-3a2d8f1568a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for project 25d426f519e8498e80c6c85158bd9042. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:26.614204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4b98ef13-d754-48c2-a357-f45599edea34 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.475382 Sep 26 05:44:26.616527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 8/15] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:44:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:44:26.627417 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-14f1fee2-2eda-4854-86ef-3a2d8f1568a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for user 9d9e9c8e26774e739695b7e4d42eeafd and project 25d426f519e8498e80c6c85158bd9042. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:26.747740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-14f1fee2-2eda-4854-86ef-3a2d8f1568a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.658720 Sep 26 05:44:26.750261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 8/16] 10.222.0.57 () {62 vars in 1200 bytes} [Mon Sep 26 05:44:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 667 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 26 05:44:27.181122 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:27.182923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:27.212403 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:27.214830 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:27.219409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:27.224536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:27.225108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:27.246061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:27.525969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:27.571460 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b336d4af-c9e4-4d5c-b06f-4e11ed881853 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1274 microversion: 2.1 time: 0.389745 Sep 26 05:44:27.596397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 9/17] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:27 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1274 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:28.600632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:28.601389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:28.628034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:28.630266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:28.636602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:28.638451 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:28.641922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:28.646154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:29.236918 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:29.277123 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d61b4145-304d-4d28-8b6f-47464ed6a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1280 microversion: 2.1 time: 0.680332 Sep 26 05:44:29.293881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 9/18] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:28 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1280 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:30.318740 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:30.319637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:30.343190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:30.347783 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:30.348711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:30.349929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:30.354476 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:30.360753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:30.841450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:30.869491 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d3f1dc65-83ad-46f5-83e4-3bb8777072d9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1280 microversion: 2.1 time: 0.555931 Sep 26 05:44:30.870508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 10/19] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:30 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1280 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:31.437772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1345640692", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a39f8ffc-12a2-4c17-a0f2-be5f6071fe30"}], "security_groups": [{"name": "tempest-securitygroup--1378019147"}], "key_name": "tempest-keypair-455244803", "user_data": "}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:31.929869 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:31.930805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:31.954769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:31.958357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:32.015195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:32.023178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:32.028138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:32.053902 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:32.055488 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=4 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:32.211121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] validate_networks() for [('a39f8ffc-12a2-4c17-a0f2-be5f6071fe30', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:44:33.514379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:33.555245 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c05d0d83-6058-4c55-8c2e-b75ee77d98ce tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 1.640983 Sep 26 05:44:33.563876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 11/20] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:31 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:34.468733 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-414543241", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "networks": [{"uuid": "1d547000-9468-4872-8f60-910e68d2881c"}]}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:34.628632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] validate_networks() for [('1d547000-9468-4872-8f60-910e68d2881c', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:44:36.484263 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:44:36.485229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:44:36.485229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:44:36.485584 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:44:36.486235 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:44:36.517884 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:36.518464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:36.518921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:36.519748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:36.530697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:36.531484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:36.551750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=20 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:36.700093 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:36.724428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for user 8c26eec9a5e841f8b760cc8cef309b18 and project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:36.779247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:44:36.793870 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:44:37.200023 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a6b8eb27-edf9-4c0c-965b-bb02068d84ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.767613 Sep 26 05:44:37.229810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 10/21] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:44:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 5798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:44:37.274663 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:37.275928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:37.308825 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:37.315464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:37.316258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:37.318204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:37.320190 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:37.322843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:37.522040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:44:37.523260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:44:37.523260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:44:37.523750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:44:37.524272 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:44:37.554611 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:37.558945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:37.560350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:37.570426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:37.575967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:37.577052 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:37.660384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=8 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:37.703303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Getting quotas for project 7edddf22ec7f41aea66bcf3e30a3d3ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:37.716307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Getting quotas for user d3842855395b47a5adc10c7480b5a4ca and project 7edddf22ec7f41aea66bcf3e30a3d3ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:37.795611 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:44:37.797980 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:44:37.965389 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3a095f2c-0aa6-4fb7-b9bc-b3a541f10422 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.394778 Sep 26 05:44:37.971999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 12/22] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:44:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:44:37.978822 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-63952125-b2a9-4f0c-9bc1-d2e5e94ff59d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:37.979818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-63952125-b2a9-4f0c-9bc1-d2e5e94ff59d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:38.272997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-63952125-b2a9-4f0c-9bc1-d2e5e94ff59d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:38.312102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-63952125-b2a9-4f0c-9bc1-d2e5e94ff59d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1237 microversion: 2.1 time: 0.326058 Sep 26 05:44:38.325192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 13/23] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:37 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1237 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:38.329632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f2950448-97be-45f4-8935-dd17be970521 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:38.351550 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f2950448-97be-45f4-8935-dd17be970521 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:38.592335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:38.629121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-603ea4c4-5d65-4be3-8809-f7764fae2d8f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 1.395391 Sep 26 05:44:38.649674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 11/24] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:37 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:39.264343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f2950448-97be-45f4-8935-dd17be970521 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:39.285861 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f2950448-97be-45f4-8935-dd17be970521 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1214 microversion: 2.1 time: 0.959211 Sep 26 05:44:39.289237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 14/25] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:38 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1214 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:39.369831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:39.372084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:39.403902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:39.405373 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:39.415819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:39.421638 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:39.424900 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:39.428252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:39.686623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:39.688153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:39.745701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:39.749830 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:39.762856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:39.762856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:39.762856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:39.770295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:39.966131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:39.999996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-adb65cd6-e189-462f-9eab-f56604cecce2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1241 microversion: 2.1 time: 0.639029 Sep 26 05:44:40.002475 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 12/26] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:39 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1241 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:40.356735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:40.357933 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:40.384823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:40.388452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:40.399000 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:40.406134 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:40.414174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:40.416820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:40.686718 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:40.697507 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-feba12d3-5cc1-4154-9e6e-cba5b1f17df6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1218 microversion: 2.1 time: 0.350794 Sep 26 05:44:40.708148 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:40 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1218 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:40.787136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:40.799963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ef3ab1f9-0a75-4e16-860e-e6e464d16439 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 1.117077 Sep 26 05:44:40.815964 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:39 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:41.049188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:41.049936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:41.066055 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:41.068823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:41.072044 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:41.076100 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:41.076616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:41.077023 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:41.365639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:41.376816 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1e69113d-4266-44e5-b54e-d672e387087f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1241 microversion: 2.1 time: 0.333328 Sep 26 05:44:41.398196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 14/29] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:41 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1241 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:41.735349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:41.736299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:41.756622 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:41.760480 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:41.764740 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:41.769127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:41.772213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:41.772653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:41.807627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1858449395", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f147de2c-29b4-4f2b-a870-47c60a471f05"}], "security_groups": [{"name": "tempest-securitygroup--1971150044"}], "key_name": "tempest-keypair-1532414122", "user_data": "}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:42.070595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:42.097892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fc9d1f08-ea5d-4623-8840-429a22afd330 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1218 microversion: 2.1 time: 0.367287 Sep 26 05:44:42.114481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 16/30] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:41 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1218 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:42.123435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:42.124353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:42.153165 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:42.154077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:42.154867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:42.157171 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:42.159958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:42.161405 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:42.409665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] validate_networks() for [('f147de2c-29b4-4f2b-a870-47c60a471f05', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:44:42.899591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:42.919319 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e95befff-349f-4f5d-a459-ee5bfce9b65f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.807527 Sep 26 05:44:42.934576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 17/31] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:42 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:42.944219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1180926868", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "439e1f14-830a-49c8-95fe-a76bc50181b7"}], "security_groups": [{"name": "tempest-securitygroup--1622314440"}], "key_name": "tempest-keypair-1801855020", "user_data": "}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:43.224883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] validate_networks() for [('439e1f14-830a-49c8-95fe-a76bc50181b7', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:44:43.308764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:44:43.310764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:44:43.313186 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:44:43.314461 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:44:43.315536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:44:43.346549 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:43.354180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:43.355112 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:43.356845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:43.362121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:43.363891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:43.412830 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:43.426799 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:43.465118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:44:43.474661 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:44:43.665926 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-01a3684c-378a-4cf7-a307-d0e7c1efcf46 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.868519 Sep 26 05:44:43.667271 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 15/32] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:44:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:44:43.712948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:43.718884 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:43.737101 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:43.738368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:43.740417 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:43.742306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:43.743490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:43.744511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:44.296570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:44.313421 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7745eb17-3392-4029-8e3b-aeed6e649eb5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1233 microversion: 2.1 time: 0.644264 Sep 26 05:44:44.320025 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 16/33] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:43 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1233 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:44.436719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:44:44.439284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:44:44.440529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:44:44.451057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:44:44.452378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:44:44.484853 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:44.492017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:44.504202 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:44.506906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:44.513457 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:44.514722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:44.578887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for project 25d426f519e8498e80c6c85158bd9042. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:44:44.638384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for user 9d9e9c8e26774e739695b7e4d42eeafd and project 25d426f519e8498e80c6c85158bd9042. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:44:44.781780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-2a756f4e-ba34-49f5-a157-bd33099c7c31 req-e52da833-48fc-4c30-a9a0-fc86ad202abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3be8a7-e6e0-46f0-bfdb-df514845bcb7", "tag": "a2412a97-1a6a-48d8-a7a8-27786cf5d323"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:44.792129 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:44:44.804313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:44:44.860127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2a756f4e-ba34-49f5-a157-bd33099c7c31 req-e52da833-48fc-4c30-a9a0-fc86ad202abf service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:44.867721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2a756f4e-ba34-49f5-a157-bd33099c7c31 req-e52da833-48fc-4c30-a9a0-fc86ad202abf service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:44.871591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2a756f4e-ba34-49f5-a157-bd33099c7c31 req-e52da833-48fc-4c30-a9a0-fc86ad202abf service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.103743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cb814b28-6e35-4c16-a3d1-46368d8b721b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.167795 Sep 26 05:44:45.112344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 18/34] 10.222.0.57 () {62 vars in 1188 bytes} [Mon Sep 26 05:44:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 05:44:45.142872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-2a756f4e-ba34-49f5-a157-bd33099c7c31 req-e52da833-48fc-4c30-a9a0-fc86ad202abf service nova] Creating event network-changed:a2412a97-1a6a-48d8-a7a8-27786cf5d323 for instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 on hv-cinder-83608 Sep 26 05:44:45.143432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2a756f4e-ba34-49f5-a157-bd33099c7c31 req-e52da833-48fc-4c30-a9a0-fc86ad202abf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 05:44:45.143835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2a756f4e-ba34-49f5-a157-bd33099c7c31 req-e52da833-48fc-4c30-a9a0-fc86ad202abf service nova] Acquired lock "compute-rpcapi-router" {{(pid=127275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 05:44:45.149678 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:45.153318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:45.156848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.165425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:45.169587 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:45.170115 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.221087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.compute.rpcapi [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 05:44:45.232315 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] Releasing lock "compute-rpcapi-router" {{(pid=127275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 05:44:45.301028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b3fa13cd-7df9-419f-b8bb-c91699ece44d None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.974963 Sep 26 05:44:45.302214 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:44:45.338868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:45.345602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:45.375052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:45.385514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:45.385514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.390603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:45.398161 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:45.400160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.604786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-807cca4d-e5a1-4eb5-a13a-04b83b67e834 req-b6693e17-c54f-4f39-83ca-f02979b12c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc", "tag": "811e152d-7a22-4e01-ad08-ecb9adcd493b"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:44:45.707236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-807cca4d-e5a1-4eb5-a13a-04b83b67e834 req-b6693e17-c54f-4f39-83ca-f02979b12c0a service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:45.708279 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-807cca4d-e5a1-4eb5-a13a-04b83b67e834 req-b6693e17-c54f-4f39-83ca-f02979b12c0a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:45.718558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-807cca4d-e5a1-4eb5-a13a-04b83b67e834 req-b6693e17-c54f-4f39-83ca-f02979b12c0a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.910211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-807cca4d-e5a1-4eb5-a13a-04b83b67e834 req-b6693e17-c54f-4f39-83ca-f02979b12c0a service nova] Creating event network-changed:811e152d-7a22-4e01-ad08-ecb9adcd493b for instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc on hv-cinder-83608 Sep 26 05:44:45.914885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-807cca4d-e5a1-4eb5-a13a-04b83b67e834 req-b6693e17-c54f-4f39-83ca-f02979b12c0a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 05:44:45.915927 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-807cca4d-e5a1-4eb5-a13a-04b83b67e834 req-b6693e17-c54f-4f39-83ca-f02979b12c0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 05:44:45.919276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:45.919775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:45.923824 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.925685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:45.926322 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:45.926765 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:45.942322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:45.973485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.compute.rpcapi [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 05:44:45.979578 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] Releasing lock "compute-rpcapi-router" {{(pid=127274) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 05:44:45.996343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dbe9ef8f-184f-4359-aced-87705afa1d5d tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1210 microversion: 2.1 time: 0.691272 Sep 26 05:44:46.047465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 18/36] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:45 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1210 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:46.061425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8c5ea149-4768-40a8-a656-bd4c813f2c80 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.941523 Sep 26 05:44:46.068446 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 19/37] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:44:46.094954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:46.100875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:46.123502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:46.124993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:46.135763 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:46.139823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:46.140526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:46.157634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:46.159610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:46.162142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:46.179832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:46.180518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:46.221282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:46.227213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:46.238183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:46.241088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:46.595074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:46.686007 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ab319530-0faf-496a-89ef-dbc9bbde7f08 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1238 microversion: 2.1 time: 0.642186 Sep 26 05:44:46.706736 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 19/38] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:46 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1238 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:46.753745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1f8a850d-bdae-41c8-9304-d24dabbf04a5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:46.758618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1f8a850d-bdae-41c8-9304-d24dabbf04a5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:47.261157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1f8a850d-bdae-41c8-9304-d24dabbf04a5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:47.277006 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1f8a850d-bdae-41c8-9304-d24dabbf04a5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:47.279579 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1f8a850d-bdae-41c8-9304-d24dabbf04a5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:47.281558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1f8a850d-bdae-41c8-9304-d24dabbf04a5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1282 microversion: 2.20 time: 0.572843 Sep 26 05:44:47.283749 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 20/39] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:46 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1282 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:47.293916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:47.294885 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:47.330632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:47.336085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:47.338215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:47.343562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:47.344720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:47.348380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:47.388359 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:47.426659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b585024f-d062-4dde-bef4-4128c4be01c3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 1.351866 Sep 26 05:44:47.429068 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 20/40] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:46 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:47.476580 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:47.477691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:47.507340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:47.510353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:47.510964 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:47.519522 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:47.520377 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:47.524511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:47.594436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:47.643415 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=63 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:47.643757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d3b4ab54-e6e5-4791-ad07-ce9e1e8dbf3c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1297 microversion: 2.1 time: 0.358078 Sep 26 05:44:47.654109 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 21/41] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:47 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1297 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:47.743587 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:47.746371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:47.777889 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:47.790645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:47.791589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:47.793078 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:47.794708 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:47.795724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:47.843640 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:47.874100 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7b9a7404-0585-40dd-9d14-208ef960ca99 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1266 microversion: 2.1 time: 0.429721 Sep 26 05:44:47.889184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:47 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1266 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:48.320665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:48.351504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0af89ab6-b167-4adb-818d-19b3ef4233e1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1238 microversion: 2.1 time: 0.614026 Sep 26 05:44:48.352325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 22/43] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:47 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1238 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:48.381966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:48.383701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:48.433467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:48.434181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:48.444419 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:48.452314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:48.462742 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:48.468758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:48.486187 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:48.486818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:48.512018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:48.512541 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:48.513068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:48.517222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:48.518010 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:48.518774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:48.972103 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:49.014104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:49.036715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:49.052611 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:49.054124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7caa3cf1-2ca2-4c72-8bc0-d587a0c18556 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.711552 Sep 26 05:44:49.055798 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-06e3771c-37c2-430f-9fbe-9e48070e6480 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.585179 Sep 26 05:44:49.073199 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 23/44] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:48 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:49.073524 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:48 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:49.078220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:49.089362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:49.092440 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:49.094739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:49.112219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:49.113995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:49.114558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:49.121155 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:49.122080 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:49.124127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:49.125243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:49.128962 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:49.130579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:49.131856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:49.138037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:49.138501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:49.331224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:49.359216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c45c685c-0085-49a0-ad38-30f3622ebd1a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1266 microversion: 2.1 time: 0.298045 Sep 26 05:44:49.365689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 23/46] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:49 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:49.399897 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:49.411016 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:49.448755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:49.464356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:49.465667 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:49.467315 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:49.471026 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:49.475431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:49.648985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:49.684570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b185d281-acc6-415e-a257-64b806496bbe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.286784 Sep 26 05:44:49.686631 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 24/47] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:49 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:50.078514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:50.102750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=79 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:50.109473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:50.119459 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-aae1c349-9603-4373-9e3d-cee59f4decc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1295 microversion: 2.1 time: 1.060717 Sep 26 05:44:50.120952 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:49 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1295 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:50.122098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:50.132892 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:50.136359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:50.148652 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:50.151730 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.152037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.153481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.155947 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.158946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:50.160457 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.160718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:50.161550 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.162512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:50.164573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.171842 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.174238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:50.370771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:50.390063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:50.393502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:50.397758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-805add18-2af6-4809-a49c-e393eae7272f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.297673 Sep 26 05:44:50.413186 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 25/49] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:50 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:44:50.413186 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:50.413186 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:50.422780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.424150 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.425609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:50.427715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.428937 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.430012 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:50.620752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:50.638275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5ab725a8-44d7-45ac-878b-cc7ed451abaa tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1274 microversion: 2.1 time: 0.236087 Sep 26 05:44:50.640256 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 26/50] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:50 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:50.641880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:50.660222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-40f63096-9654-4216-b176-e293781dce5b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.537018 Sep 26 05:44:50.674822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 25/51] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:50 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:50.742734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:50.743832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:50.772071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.773063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.773878 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:50.787066 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:50.790920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:50.791704 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.000105 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:51.023790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d60753c8-d35d-491c-8cb8-32ef3627af25 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.287638 Sep 26 05:44:51.024858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 27/52] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:50 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:51.152858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:51.154329 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:51.170455 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.171776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.172845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.174815 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.175936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.176998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.444319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:51.446892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:51.447622 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:51.458645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.460242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.460750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.462695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3d39446b-49e9-493a-a458-3f582a6aa46b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.315047 Sep 26 05:44:51.463829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.464258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 26/53] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:51 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:51.473417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.473417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.594869 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:51.606259 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:51.607825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:51.619892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1064beed-ae7c-4d46-99fc-a3a773c77cd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.175681 Sep 26 05:44:51.620641 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 28/54] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:51 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:51.682058 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:51.686803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:51.688351 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:51.689085 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:51.695955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.696862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.697599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.698502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.699179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.699699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.702546 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.706399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.707146 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.708698 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:51.709504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:51.712301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:51.843043 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:51.855586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6031b4e5-a9c3-4988-9c64-55d0d8f8bfbb tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1284 microversion: 2.1 time: 0.181545 Sep 26 05:44:51.856550 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 27/55] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:51 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:51.906307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:51.915214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-524c6579-447c-4d86-a17f-8262455dd04f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.230967 Sep 26 05:44:51.916258 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 29/56] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:51 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:52.065900 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:52.066811 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:52.074577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.075251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.075914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.076889 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.077436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.078082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.189149 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:52.206197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2d49da1f-cdc6-4db5-acc9-f70fe0455b7d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.144705 Sep 26 05:44:52.207640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 28/57] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:52 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:52.506355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:52.507363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:52.518626 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.519252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.523122 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.525478 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.526863 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.527740 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.672008 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:52.672922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:52.708250 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.709047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.709991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.711455 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.712932 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.713934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.751777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:52.763456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-06c0fef9-6869-441a-b25b-d84e7e50051f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.262061 Sep 26 05:44:52.764486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 30/58] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:52 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:52.833715 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:52.846925 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:52.850163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:52.851998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7202948c-fc8c-4f33-b91f-7e200fd9464b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.184880 Sep 26 05:44:52.852957 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 29/59] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:52 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:52.885198 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:52.885826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:52.892678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.893216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.893663 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.894396 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.894973 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.895403 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.944722 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:52.946156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:52.957874 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.959550 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.960399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.962018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:52.963446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:52.964176 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:52.985527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:53.008992 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-34b66abb-19e2-4f76-84dd-7244624b144f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1284 microversion: 2.1 time: 0.126956 Sep 26 05:44:53.010842 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 31/60] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:52 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:53.164412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:53.175064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5124e360-67c3-4726-bbc9-c8a914dc31da tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.238042 Sep 26 05:44:53.175726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 30/61] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:52 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:53.254249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:53.254866 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:53.261739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:53.262235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:53.262670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:53.263402 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:53.263867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:53.264288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:53.335529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:53.344736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-12d9db30-ad7c-43a8-a680-096eaaa55939 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.094438 Sep 26 05:44:53.345392 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 32/62] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:53 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:53.809091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:53.810154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:53.822383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:53.823257 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:53.823762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:53.828568 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:53.830039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:53.830716 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:53.882467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:53.883637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:53.895519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:53.896716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:53.897752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:53.899432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:53.900574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:53.901533 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:54.015927 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:54.030988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:54.034057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:54.036624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7654f549-f0db-4128-876f-83e38dc50f3e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.161204 Sep 26 05:44:54.041383 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 33/63] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:53 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:54.056533 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:54.058657 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:54.080595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:54.081348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:54.082099 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:54.083772 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:54.084667 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:54.085442 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:54.085584 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:54.102071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4531a746-5e6b-4114-b6ce-4d390ea4e261 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.302578 Sep 26 05:44:54.102963 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 31/64] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:53 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:54.205975 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:54.206901 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:54.207699 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:54.219550 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-21806f05-b9e2-46c9-8a3b-f6ead7afcaca tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1284 microversion: 2.1 time: 0.172957 Sep 26 05:44:54.220244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:54.220745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:54.221209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:54.221329 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 34/65] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:54 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:54.221944 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:54.222422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:54.227637 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:54.374850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:54.375995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:54.399060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:54.399928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:54.400734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:54.402303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:54.402947 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:54.403749 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:54.517201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:54.529790 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-282a1026-72c1-4cb9-ae31-c94f4282ab0f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.334479 Sep 26 05:44:54.531288 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 32/66] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:54 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:54.597375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:54.615559 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7b148982-2d88-4ff2-b236-d8d93d631077 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.248749 Sep 26 05:44:54.630114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 35/67] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:54 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:55.084845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:55.085884 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:55.094098 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.094789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.095307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.096116 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.096719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.097153 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.134526 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:55.138054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:55.153873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=16 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:55.157192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.158129 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.159039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.160712 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.161969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.163059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.209327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:55.216713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=6 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:55.231649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:55.236210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:55.244293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bc1007fc-ae1d-441c-827e-c05f1b3c2ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.159108 Sep 26 05:44:55.245822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 33/68] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:55 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:55.285047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:55.289044 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:55.310239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.311537 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.312316 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.313676 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.321861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.323290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.454531 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:55.465882 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2c638151-55b3-4bc9-a0a5-e652b527e18f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1284 microversion: 2.1 time: 0.216466 Sep 26 05:44:55.478346 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 34/69] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:55 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:55.535043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:55.545010 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8f1341d6-2984-45fe-a628-11ea374d0e4f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.414770 Sep 26 05:44:55.546566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 36/70] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:55 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:55.577828 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:55.578628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:55.590278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.590775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.591206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.591962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.592425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.592864 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.662323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:55.663514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:55.673890 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.674506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.676991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.676991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:55.676991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:55.676991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:55.771363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:55.787518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a326870c-b37b-49e0-b952-f023a6419214 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.132292 Sep 26 05:44:55.788556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 37/71] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:55 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:55.799582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:55.814587 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-58b58c10-649a-4310-b249-1e8257156a32 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.241248 Sep 26 05:44:55.815581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 35/72] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:55 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:56.296674 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:56.297564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:56.299645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=6 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:56.306668 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.307250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.307729 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.308565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.310229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.310229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.313791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:56.384166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:56.394526 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:56.396219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:56.397677 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3b478f54-854c-452a-aa9c-16e63ad5d16e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.105472 Sep 26 05:44:56.398332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 38/73] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:56 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:56.492351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:56.493002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:56.500494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.501011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.501509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.502323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.502807 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.503291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.576906 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:56.588121 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:56.589221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0b7a56f8-83bc-4033-9b54-2e7d11c438ea tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1284 microversion: 2.1 time: 0.101242 Sep 26 05:44:56.589413 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:56.590114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 36/74] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:56 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:56.601521 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.602467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.603225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.604482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.605340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.605851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.778296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:56.794244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-67936f35-e0e1-4cb4-8e64-1314cbb4e90a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.213483 Sep 26 05:44:56.795461 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 39/75] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:56 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:56.814651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:56.815591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:56.822977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.823672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.824167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.824968 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.825610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.826116 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.841009 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:56.841809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:56.850313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.851034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.851591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.852438 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:56.853169 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:56.853826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:56.917211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:56.936466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fce2979b-8935-4ebf-8968-06c1d8ee9bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.125868 Sep 26 05:44:56.937563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 37/76] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:56 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:57.067978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:57.082474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-08dac842-bf02-46dd-b78c-b29a8f8a2c65 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.245325 Sep 26 05:44:57.083680 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 40/77] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:56 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:57.423744 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:57.424599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:57.427219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=24 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:57.434796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.435280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.435810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:57.436805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.437543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.438124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:57.507896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:57.517344 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:57.519030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:57.520395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d208a33e-1b3b-40fb-8ff9-bd8da0bb01b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.100702 Sep 26 05:44:57.520991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 38/78] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:57 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:57.616060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:57.616831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:57.623851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.624476 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.625029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:57.625890 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.626396 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.626849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:57.694089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:57.705638 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-673d0e26-90cd-4bdf-b1b3-595e9c12d289 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1284 microversion: 2.1 time: 0.093542 Sep 26 05:44:57.706349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 41/79] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:57 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:57.819898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:57.820510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:57.827434 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.827932 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.828352 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:57.829074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.829560 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.829997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:57.965426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:57.966848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:57.983003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.983799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.984852 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:57.986059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:57.987062 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:57.987759 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:58.003771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:58.015988 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-781146dd-2b8f-43d5-a7e7-eb36953124ac tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.199965 Sep 26 05:44:58.017241 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 39/80] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:57 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:58.074146 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:58.083332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-770ae30f-fe90-4d17-a439-367b494b6530 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.124946 Sep 26 05:44:58.083936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 42/81] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:57 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:58.112578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:58.113294 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:58.120799 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:58.121468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:58.121953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:58.122772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:58.123325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:58.123847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:58.282004 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:58.294003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-aaf52bb8-e7b3-42ff-8e2c-2a1a92756076 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.185293 Sep 26 05:44:58.294598 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 40/82] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:58 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:58.546077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:58.546726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:58.554639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:58.555214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:58.555739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:58.556533 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:58.557094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:58.558105 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:58.630679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:58.640676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:58.642486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:58.643738 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e88adda5-2a57-4aae-9d6d-139e2a76dd46 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.102273 Sep 26 05:44:58.644403 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 43/83] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:58 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:44:58.731871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:58.732466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:58.739344 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:58.739837 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:58.740275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:58.741000 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:58.741508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:58.741933 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:58.759670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:58.812439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:58.821532 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b16904de-ca8b-485f-9a77-5aa0315d8027 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1284 microversion: 2.1 time: 0.093856 Sep 26 05:44:58.822204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 41/84] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:58 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:59.044747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:59.045485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:59.054154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.055013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.055694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.056643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.058094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.058633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.108121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:59.108786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:59.117882 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.118658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.119211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.120206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.120896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.121491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.261415 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:59.270078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-20f87a77-1a02-42c5-9756-83538d6e4ef3 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.229331 Sep 26 05:44:59.270679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 44/85] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:59 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:59.338877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:59.339491 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:59.346304 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.346801 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.347227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.348006 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.348476 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.349010 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.372258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:59.382243 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-be720f54-8609-49cb-9399-e2319122ae5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.278103 Sep 26 05:44:59.383159 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 42/86] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:59 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:44:59.668433 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:59.677701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4801d14f-cb74-4db0-bbc8-9fd72629a1ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.343096 Sep 26 05:44:59.679762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:59.681620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:59.693875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 45/87] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:59 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:44:59.699640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.701258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.702589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.703865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.705273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.706065 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.825674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:59.838868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:59.842336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:44:59.843742 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f234f40d-402c-4e4c-90ec-665be41a4a32 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.177072 Sep 26 05:44:59.844552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 43/88] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:44:59 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:44:59.851749 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:44:59.852923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:44:59.865979 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.867452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.868633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:44:59.870454 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:44:59.871788 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:44:59.872880 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.072754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:00.093961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-842cf32a-3a4e-4d80-8e27-7cb88bc64d95 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1272 microversion: 2.1 time: 0.250537 Sep 26 05:45:00.096277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 46/89] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:44:59 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:00.300662 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:00.301853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:00.313860 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.314778 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.315917 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.317880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.319063 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.320203 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.423401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:00.424834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:00.428474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:00.438671 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.439556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.440391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.442209 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.443040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.443900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.562080 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:00.576910 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b04efe4f-50fd-475d-83f2-0e8d6edd7f26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.161558 Sep 26 05:45:00.585531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 47/90] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:00 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:00.705739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:00.706977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:00.718925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.719820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.720856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.722155 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.722816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.723792 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.902623 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:00.918369 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7d6e52c6-769c-4e8a-adeb-0cbf89cccacc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.623897 Sep 26 05:45:00.933755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 44/91] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:00 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:00.952432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:00.959342 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:00.960887 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:00.963685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-554c4a21-c1e9-4b16-8b35-fcc2fc66ad3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.264190 Sep 26 05:45:00.973679 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.975036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.975712 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 48/92] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:00 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:00.976619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:00.978230 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:00.979432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:00.980457 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.133850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:01.136147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:01.150699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:01.152205 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:01.153014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.154779 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:01.155945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:01.157044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.201723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:01.226601 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:01.234553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:01.236524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b72923f9-f1bc-4d0b-a8d2-3662ea691952 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.301086 Sep 26 05:45:01.242548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 45/93] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:00 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:01.303681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:01.318158 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5e7b2373-4a43-45cd-918c-4fafdfe0d9c4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1272 microversion: 2.1 time: 0.189581 Sep 26 05:45:01.319951 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 49/94] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:01 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:01.566808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-a882e65d-ada9-427e-80bd-c5f2fccf461c req-8943d500-4c4e-4c27-9963-e0fdaeb01ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0853094-da33-4e22-a597-b0df1980229b", "tag": "874e44a1-6cb8-479e-b4b0-e68322b26e1f"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:01.589708 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a882e65d-ada9-427e-80bd-c5f2fccf461c req-8943d500-4c4e-4c27-9963-e0fdaeb01ab3 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:01.590717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a882e65d-ada9-427e-80bd-c5f2fccf461c req-8943d500-4c4e-4c27-9963-e0fdaeb01ab3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:01.591565 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a882e65d-ada9-427e-80bd-c5f2fccf461c req-8943d500-4c4e-4c27-9963-e0fdaeb01ab3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.621724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-a882e65d-ada9-427e-80bd-c5f2fccf461c req-8943d500-4c4e-4c27-9963-e0fdaeb01ab3 service nova] Creating event network-changed:874e44a1-6cb8-479e-b4b0-e68322b26e1f for instance a0853094-da33-4e22-a597-b0df1980229b on hv-cinder-83608 Sep 26 05:45:01.624650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:01.626970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:01.632228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-a882e65d-ada9-427e-80bd-c5f2fccf461c req-8943d500-4c4e-4c27-9963-e0fdaeb01ab3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070659 Sep 26 05:45:01.633710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 46/95] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:45:01.643036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:01.643036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:01.643036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.660580 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:01.661416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:01.662134 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.742386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:01.752651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0a0b1124-213d-425c-934f-5dd7d1aa14ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.136101 Sep 26 05:45:01.753449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 50/96] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:01 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:01.962301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:01.963097 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:01.970259 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:01.970826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:01.971174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.971899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:01.972329 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:01.972773 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:01.995140 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:01.996286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:02.003567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.004466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.005060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.005995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.006659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.007542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.214914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:02.226376 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:02.226936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-95b3d2ab-ec38-4110-b93d-230ed3afcb03 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.269295 Sep 26 05:45:02.229110 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 47/97] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:01 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:02.249527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4939807f-c6b0-4f9d-8f94-597e1c82f520 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.260018 Sep 26 05:45:02.250868 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 51/98] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:01 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:02.267119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:02.267727 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:02.275260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.275787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.276278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.277041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.277539 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.277960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.348168 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:02.356286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:02.357198 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:02.358306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:02.360370 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:02.361983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6ebfde91-5ed9-41ce-be69-c1a46c336179 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.099443 Sep 26 05:45:02.362790 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 48/99] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:02 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:02.366312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.366898 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.367905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.369323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.370739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.371539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.553952 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:02.568181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-76eec827-8d59-42b6-b187-56ff5e1cdd36 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.216124 Sep 26 05:45:02.569179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 52/100] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:02 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:02.790819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:02.791374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:02.809018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.809800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.810413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.811607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:02.812243 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:02.812812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:02.887902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:02.897740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0824d377-b57f-4320-9356-5bef674ef3bd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.111390 Sep 26 05:45:02.898341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 49/101] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:02 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:03.252497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:03.253426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:03.260822 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.261424 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.261860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.262634 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.263150 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.263586 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.275520 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:03.277234 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:03.287033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.287530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.290562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.291982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.292569 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.292958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.462652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:03.468007 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:03.476529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-48e9fb1b-8e81-4d85-aaff-e0a8e95b40d2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.227660 Sep 26 05:45:03.477873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 53/102] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:03 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:03.483371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-007af011-7878-4381-abd7-6aa336fadc34 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.212139 Sep 26 05:45:03.484750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 50/103] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:03 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:03.487218 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:03.489204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:03.502507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.503974 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.505172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.506859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.507783 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.508805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.589708 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:03.592567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:03.602835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:03.604579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:03.605418 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:03.606175 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-50704fd2-d3ce-41c7-94b7-4fa546f0ab81 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.126417 Sep 26 05:45:03.606351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:03.607021 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 54/104] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:03 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:03.614622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.615234 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.615723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.616558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.617250 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.617794 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.768672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:03.777407 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-389f922c-0d32-4ecb-b1eb-944ca1b51860 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.176663 Sep 26 05:45:03.778163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 51/105] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:03 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:03.923002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:03.923631 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:03.931011 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.931510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.931944 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:03.932681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:03.933101 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:03.933546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.005783 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:04.014942 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-30cd073b-518f-4f81-a93a-bb915bc01334 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.096149 Sep 26 05:45:04.015570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 55/106] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:03 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:04.514996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:04.515617 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:04.524181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:04.524871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:04.526060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.526967 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.527834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.529359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.530258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.531061 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.532525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.533019 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.533472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.534195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.534624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.535039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.726119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:04.734714 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5ef3b59f-78ad-47bf-b795-8eda112d02ed tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.223769 Sep 26 05:45:04.735323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 52/107] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:04 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:04.740327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:04.740928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:04.748099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.748717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.749171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.749917 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.750371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.750791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.761515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:04.770999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7b78e1a3-0dd2-4d91-b06b-02af77792e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.250918 Sep 26 05:45:04.771718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 56/108] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:04 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:04.802551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:04.803170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:04.810167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.810812 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.811290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.812112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:04.812616 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:04.813247 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:04.845265 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:04.856226 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:04.857752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:04.858920 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d1970104-8d45-4260-af9e-3ea4caee2fb0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.122554 Sep 26 05:45:04.859542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 53/109] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:04 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:04.994423 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:05.003536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f4f1699e-4b87-4f11-b4d3-e38e6a44fb1b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.205177 Sep 26 05:45:05.004151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 57/110] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:04 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:05.040881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:05.041528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:05.048322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:05.048869 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:05.049447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:05.050252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:05.050812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:05.051654 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:05.141194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:05.155489 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-af9e4287-e381-4469-86d2-2b41c50829b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.118258 Sep 26 05:45:05.156405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 54/111] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:05 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:05.772118 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:05.772923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:05.782902 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:05.783802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:05.784368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:05.785655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:05.790267 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:05.791767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:05.798222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:05.799840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:05.810954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:05.811829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:05.812575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:05.813581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:05.814464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:05.815254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:05.975028 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:05.978648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:05.984781 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2d72ad24-c099-49f5-bada-d2a23f729496 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.219431 Sep 26 05:45:05.985657 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 58/112] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:05 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:05.987843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d57eb201-e058-4be9-9cb0-c088cb942fdb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.195672 Sep 26 05:45:05.989092 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 55/113] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:05 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:05.992540 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:05.993165 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:06.000885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:06.001678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:06.002451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:06.003604 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:06.004076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:06.004543 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:06.027580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:06.028173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:06.035020 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:06.035590 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:06.036042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:06.036765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:06.037252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:06.037676 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:06.081959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:06.097174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:06.100257 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:06.102334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f8a93757-71bf-444c-b222-2b5427624639 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.115216 Sep 26 05:45:06.103425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 59/114] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:05 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:06.195087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:06.195603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:06.202416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:06.202912 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:06.203368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:06.204094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:06.204545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:06.204965 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:06.207818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:06.219002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-989c28c5-6b0c-4272-9865-d94e3db38e7e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.195455 Sep 26 05:45:06.220111 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 56/115] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:06 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:06.280080 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:06.291830 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-837daa45-7054-427a-805d-44d2c9215369 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.101716 Sep 26 05:45:06.292547 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 60/116] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:06 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:07.015079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:07.015925 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:07.016367 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:07.017595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:07.022767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.023257 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.023678 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.024396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.024849 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.025303 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.026402 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.027185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.027752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.028697 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.029319 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.029985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.182456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:07.183451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:07.191488 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b0a203ba-746d-4898-8176-0ac594e070ad tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.180478 Sep 26 05:45:07.192122 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 57/117] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:07 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:07.192718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-bd7b96ae-4e09-4914-912c-c3c4b036bdf8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.180675 Sep 26 05:45:07.193915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 61/118] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:07 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:07.196998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:07.197650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:07.204098 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.204597 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.205023 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.205761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.206213 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.206630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.245991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:07.246839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:07.254210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.254732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.255227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.256022 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.256508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.256928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.283024 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:07.287156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:07.300090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:07.302686 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:07.304492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-284e0440-9c92-4fe2-890f-2208248cb2e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.111207 Sep 26 05:45:07.305278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 58/119] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:07 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:07.318399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:07.319139 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:07.326715 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.327318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.327850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.328659 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:07.329218 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:07.329739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:07.411370 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:07.421215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ca8bc0c9-297f-49a3-ac79-c3b6267134cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.107382 Sep 26 05:45:07.422036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 59/120] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:07 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:07.445171 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:07.454124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9c19665d-aa89-4d45-a724-afd5bc967c09 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.213920 Sep 26 05:45:07.454747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 62/121] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:07 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:08.233926 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:08.234826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:08.235468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:08.236008 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:08.243574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.244142 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.244642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.245481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.246022 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.246504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.248090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.248942 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.249815 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.251083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.251948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.252737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.415305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:08.425878 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6982880b-f92c-4a11-aa7e-f2230e7d257e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.200783 Sep 26 05:45:08.426699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 63/122] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:08 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:08.432455 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:08.433242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:08.440432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.441045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.441511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.442295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.442898 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.443316 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.492334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:08.504260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8253c7dc-a5aa-4721-9845-55efb7de82f9 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.277023 Sep 26 05:45:08.504870 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 60/123] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:08 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:08.510239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:08.510854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:08.523444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.524246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.525253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.525827 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.526381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.527414 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.537728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:08.554154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:08.558436 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:08.560582 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3c3e67a9-3194-49fe-bca5-33f67e858959 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.132500 Sep 26 05:45:08.561852 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 64/124] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:08 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:08.570558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:08.571747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:08.583513 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.584350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.585156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.586451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:08.587646 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:08.588344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:08.612772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:08.621971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1e4bd326-4962-4e72-bdd5-54e9268285e2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.115840 Sep 26 05:45:08.622576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 61/125] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:08 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:08.769384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:08.781062 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3796e50e-de27-4b49-96c2-508683c704df tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.217864 Sep 26 05:45:08.781745 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 65/126] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:08 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:09.464341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:09.465088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:09.473383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.473943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.474472 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.475412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.475994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.476468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.542431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:09.543758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:09.554671 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.555277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.556013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.558226 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.562979 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.563969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.677760 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:09.686732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bfa7a344-c860-4d1c-9963-279956ed2cb1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.226944 Sep 26 05:45:09.687339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 62/127] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:09 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:09.696146 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:09.697632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:09.710394 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.712150 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.712914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.714585 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.715583 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.716479 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.790844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:09.805505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:09.809903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:09.813239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:09.815056 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d398f06c-cd9e-4506-b17c-be6a39032120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.276967 Sep 26 05:45:09.815491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-480a6c3e-7de8-4b69-a4d6-de47becdbe5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.126702 Sep 26 05:45:09.825295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 66/128] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:09 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:09.825613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 63/129] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:09 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:09.829244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:09.829244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:09.839955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:09.839955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:09.840358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.840886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.841716 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.842238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.842732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.842999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.843170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.843803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.843945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:09.844305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:09.844562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.844719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:09.938834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:09.949172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c9f6a0d9-bc00-4d92-86da-bd1bba113a67 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.121823 Sep 26 05:45:09.950146 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 67/130] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:09 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:10.033319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:10.049233 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0948669f-ec12-4b3d-be62-7cb15f9d29c3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.230160 Sep 26 05:45:10.050290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 64/131] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:09 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:10.725693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:10.726693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:10.734958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:10.735637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:10.736230 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:10.737158 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:10.737899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:10.738635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:10.856599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:10.859084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:10.872392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:10.873413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:10.874366 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:10.875875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:10.877114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:10.877947 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:10.936147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:10.951336 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8836eea9-3043-47fc-be54-22ec07fb424a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.229636 Sep 26 05:45:10.968949 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 68/132] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:10 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:10.995856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:10.998458 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:11.014570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:11.015659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:11.016623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:11.018124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:11.019526 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:11.021485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:11.032081 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:11.047267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:11.077645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:11.077645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-940a1e84-49ec-4f6c-a7d6-e8a2ed52a19b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.226851 Sep 26 05:45:11.085119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 65/133] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:10 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:11.115396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:11.118823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:11.138640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:11.141271 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:11.141943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:11.147776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:11.148472 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:11.149075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:11.311341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:11.326008 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-76526a21-7a6c-446a-b270-44266d111aaf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.238822 Sep 26 05:45:11.326937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 66/134] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:11 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:11.336377 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:11.338207 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:11.355997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:11.356496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:11.356943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:11.357690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:11.358140 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:11.358639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:11.364399 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:11.374402 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-424c1e7b-09d2-49d7-99e7-7c4d27ce6d74 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.403698 Sep 26 05:45:11.375773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 69/135] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:10 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:11.533855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:11.543731 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bece9753-3eba-45c7-bea6-ed7674a5366b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.214239 Sep 26 05:45:11.544359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 67/136] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:11 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:12.003261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:12.003905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:12.010968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.011497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.011918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.012639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.013088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.013541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.127104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:12.127907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:12.135379 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.135946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.136556 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.137591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.138231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.138676 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.197538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:12.215760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c4cbc768-9971-4e90-add2-01f96a2f95d8 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.216218 Sep 26 05:45:12.216901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 70/137] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:11 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:12.230643 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:12.245124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:12.247281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:12.248540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-29f9b1c4-f63f-4771-9d8c-eee1d0bed018 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.129339 Sep 26 05:45:12.249431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 68/138] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:12 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:12.369857 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:12.371999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:12.384833 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.385640 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.386371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.387869 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.388920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.390269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.406532 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:12.407613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:12.419969 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.419969 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.419969 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.421300 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.421985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.422535 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.440604 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:12.525814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:12.547191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7e3e7e4a-7535-441b-a3d1-6a51c0956f87 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1294 microversion: 2.1 time: 0.178627 Sep 26 05:45:12.547191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 71/139] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:12 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1294 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:12.569820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:12.570435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:12.577165 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.577897 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.578538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.579439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:12.580058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:12.580653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:12.714914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:12.733193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-edd2abc2-2d4c-4b20-b426-71f9b2c1a9cb tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.333544 Sep 26 05:45:12.735091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 69/140] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:12 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:12.830829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:12.840191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0f4a45ad-5a99-4aba-a8bc-a8820ab3dee6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.275054 Sep 26 05:45:12.841172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 72/141] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:12 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:13.254430 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:13.257013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:13.281237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:13.282062 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:13.284370 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.288486 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.290149 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:13.291482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.292364 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.293099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:13.303086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.303881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.304586 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:13.306120 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.306873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.307872 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:13.535123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:13.563698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:13.568241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:13.572862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a72be4d1-8cd7-4cc8-8ba0-6934db873fd7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1278 microversion: 2.20 time: 0.300720 Sep 26 05:45:13.575803 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 73/142] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:13 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1278 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:13.585572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:13.589227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:13.599651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.600818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.601475 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:13.603208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.603980 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.604718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:13.698429 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:13.708746 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a1688f9f-0994-43f5-ae33-3940d705319b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1302 microversion: 2.1 time: 0.130861 Sep 26 05:45:13.709412 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 74/143] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:13 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:13.776386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:13.794727 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:13.821752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.822251 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.827141 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:13.831000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:13.838849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:13.839768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:14.610567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:14.669246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-961b7d52-5d8a-4212-9b71-783e7aa0b87d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.898336 Sep 26 05:45:14.671241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 75/144] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:13 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:14.713906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:14.720908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:14.752811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:14.753839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:14.754834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:14.762250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:14.763313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:14.764115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:14.974361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:14.997665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-77b55ce0-9eb8-4139-8b2d-586852e9c5d0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 1.754015 Sep 26 05:45:15.013669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 70/145] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:13 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:15.020700 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:15.021694 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:15.033634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:15.034452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:15.036328 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:15.042093 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:15.042877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:15.043321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:15.508490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:15.531981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-34d90083-e9a7-4106-bbe9-d937a170fa8f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.854300 Sep 26 05:45:15.540602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 76/146] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:14 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:15.546237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:15.547128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:15.566070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:15.567231 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:15.569438 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:15.571690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:15.580195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:15.583040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:15.593386 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:15.631691 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:15.641664 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:15.644221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a08ee33f-67c0-4e37-a3a6-33458379a956 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1342 microversion: 2.20 time: 0.628475 Sep 26 05:45:15.646178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 71/147] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:15 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1342 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:15.708060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:15.708998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:15.717381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:15.718257 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:15.718858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:15.720075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:15.721119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:15.721747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:15.789761 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:15.799682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-33e55650-9de6-44cc-8706-ce84130deaaa tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1300 microversion: 2.1 time: 0.257436 Sep 26 05:45:15.804923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 77/148] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:15 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:16.049546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:16.050554 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:16.061861 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:16.066077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:16.068452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:16.070825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:16.074409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:16.075529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:16.629176 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:16.684635 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4eb02fd8-26f3-49e3-a8e6-b9bcb9568ef5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.980780 Sep 26 05:45:16.691281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 72/149] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:15 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:16.702684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:16.704288 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:16.719880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:16.723722 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:16.725775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:16.728318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:16.730061 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:16.731426 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:17.062026 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:17.106575 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0fe30d87-5990-4a32-9794-8d8514c50803 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 1.059003 Sep 26 05:45:17.116481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 78/150] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:16 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:17.150447 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:17.157594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:17.201537 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:17.208476 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:17.219038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:17.220017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:17.222878 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:17.223716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:17.388098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:17.408489 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:17.415089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:17.416458 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3d1c54ed-85d1-4b61-a8d0-3d4c64406e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1340 microversion: 2.20 time: 0.295654 Sep 26 05:45:17.421714 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 79/151] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:17 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1340 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:17.431832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:17.438985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:17.464681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:17.475208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:17.475880 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:17.478700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:17.480338 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:17.480898 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:17.768841 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:17.796014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a2d0840c-2007-45a4-9837-ba6939e38979 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.372370 Sep 26 05:45:17.800967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 80/152] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:17 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:17.862183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:17.882584 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-60c56744-8dac-4ef7-b003-86f4e35da808 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 1.189023 Sep 26 05:45:17.884771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 73/153] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:16 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:17.896084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:17.899248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:17.917732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:17.922253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:17.922832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:17.923696 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:17.924255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:17.924755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:18.099391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-d8bd4d1b-e2b6-412c-99e6-c1b508b1f32f req-aafd0e57-4262-4970-bd62-9045e87ca08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc", "name": "network-vif-plugged", "status": "completed", "tag": "811e152d-7a22-4e01-ad08-ecb9adcd493b"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:18.127549 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-d8bd4d1b-e2b6-412c-99e6-c1b508b1f32f req-aafd0e57-4262-4970-bd62-9045e87ca08f service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:18.130470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-d8bd4d1b-e2b6-412c-99e6-c1b508b1f32f req-aafd0e57-4262-4970-bd62-9045e87ca08f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:18.131797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-d8bd4d1b-e2b6-412c-99e6-c1b508b1f32f req-aafd0e57-4262-4970-bd62-9045e87ca08f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:18.166957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-d8bd4d1b-e2b6-412c-99e6-c1b508b1f32f req-aafd0e57-4262-4970-bd62-9045e87ca08f service nova] Creating event network-vif-plugged:811e152d-7a22-4e01-ad08-ecb9adcd493b for instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc on hv-cinder-83608 Sep 26 05:45:18.178402 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-d8bd4d1b-e2b6-412c-99e6-c1b508b1f32f req-aafd0e57-4262-4970-bd62-9045e87ca08f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370893 Sep 26 05:45:18.182905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 81/154] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:18.196920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:18.200753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:18.229450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:18.230855 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:18.231994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:18.233721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:18.239887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:18.241291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:18.522281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:18.543070 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8c25f73f-eabc-4007-94d1-cae54b4cd83b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.655606 Sep 26 05:45:18.543753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 74/155] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:17 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:18.549038 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:18.550156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:18.565576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:18.567287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:18.568007 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:18.568701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:18.569659 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:18.570244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:18.570845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:18.634128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:18.720325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:18.740717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:18.742306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:18.743784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dd3826ed-031f-4384-9e0b-4d3c4ffde654 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1340 microversion: 2.20 time: 0.198861 Sep 26 05:45:18.744791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 75/156] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:18 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1340 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:18.849399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:18.850054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:18.874589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:18.875671 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:18.877750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:18.879375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:18.883993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:18.884431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:19.137380 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:19.172817 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d57af9b3-a358-484d-8b9d-6d6549a7d04c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.982257 Sep 26 05:45:19.176222 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 82/157] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:18 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:19.184303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:19.185908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:19.202958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:19.204515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:19.206881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:19.208679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:19.210817 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:19.213426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:19.590147 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:19.604127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4d362e82-3554-44da-90ed-07c680ff4490 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.759013 Sep 26 05:45:19.620017 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 76/158] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:18 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:19.635823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-73d35946-4571-4d2d-a8cc-32506e0ace9b req-2ae88fa9-7aa1-4ab4-bb52-284081d7c0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9", "tag": "f2e668fd-4af3-4593-b411-7b18149bed4b"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:19.650317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-73d35946-4571-4d2d-a8cc-32506e0ace9b req-2ae88fa9-7aa1-4ab4-bb52-284081d7c0b0 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:19.651197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-73d35946-4571-4d2d-a8cc-32506e0ace9b req-2ae88fa9-7aa1-4ab4-bb52-284081d7c0b0 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:19.652465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-73d35946-4571-4d2d-a8cc-32506e0ace9b req-2ae88fa9-7aa1-4ab4-bb52-284081d7c0b0 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:19.671242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-73d35946-4571-4d2d-a8cc-32506e0ace9b req-2ae88fa9-7aa1-4ab4-bb52-284081d7c0b0 service nova] Creating event network-changed:f2e668fd-4af3-4593-b411-7b18149bed4b for instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 on hv-cinder-83608 Sep 26 05:45:19.681346 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-73d35946-4571-4d2d-a8cc-32506e0ace9b req-2ae88fa9-7aa1-4ab4-bb52-284081d7c0b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060573 Sep 26 05:45:19.683492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 77/159] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:19.689654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:19.700472 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:19.703177 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:19.712554 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ef26fdf0-186a-4ca0-9911-3e9190161752 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.534634 Sep 26 05:45:19.713193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 83/160] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:19 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:19.717374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:19.718357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:19.719180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:19.720769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:19.722182 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:19.723216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:19.795186 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:19.796485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:19.811275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:19.812268 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:19.812894 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:19.813837 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:19.816966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:19.817681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.017209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:20.038335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0744eca0-a180-4097-9b6b-18463942f103 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.352426 Sep 26 05:45:20.053201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 78/161] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:19 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:20.089640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-6f64b426-e0bd-4efd-9924-67569e799bfa req-c10f3064-04c0-4ac5-a558-6c2b765651f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea993d78-323c-4565-9a8e-db170bd7954a", "tag": "6f3cd267-47c3-4bd9-9283-70669f0b6b2c"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:20.108422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6f64b426-e0bd-4efd-9924-67569e799bfa req-c10f3064-04c0-4ac5-a558-6c2b765651f5 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.109354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6f64b426-e0bd-4efd-9924-67569e799bfa req-c10f3064-04c0-4ac5-a558-6c2b765651f5 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.110629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6f64b426-e0bd-4efd-9924-67569e799bfa req-c10f3064-04c0-4ac5-a558-6c2b765651f5 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.128251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-6f64b426-e0bd-4efd-9924-67569e799bfa req-c10f3064-04c0-4ac5-a558-6c2b765651f5 service nova] Creating event network-changed:6f3cd267-47c3-4bd9-9283-70669f0b6b2c for instance ea993d78-323c-4565-9a8e-db170bd7954a on hv-cinder-83608 Sep 26 05:45:20.136831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-6f64b426-e0bd-4efd-9924-67569e799bfa req-c10f3064-04c0-4ac5-a558-6c2b765651f5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052220 Sep 26 05:45:20.138341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 79/162] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:45:20.169758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:20.184368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:20.186643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:20.187863 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-954c6596-c080-444e-8696-93d4020b4285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.397147 Sep 26 05:45:20.188482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 84/163] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:19 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:20.221748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:20.223702 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:20.235733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.235733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.235733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.235733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.236233 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.236233 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.314226 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-3896f643-58bf-4b75-a11e-9a7b231a629c req-671ad024-652c-4327-8546-d473c533ce0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3be8a7-e6e0-46f0-bfdb-df514845bcb7", "name": "network-vif-plugged", "status": "completed", "tag": "a2412a97-1a6a-48d8-a7a8-27786cf5d323"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:20.344554 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-3896f643-58bf-4b75-a11e-9a7b231a629c req-671ad024-652c-4327-8546-d473c533ce0c service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.345505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-3896f643-58bf-4b75-a11e-9a7b231a629c req-671ad024-652c-4327-8546-d473c533ce0c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.346036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-3896f643-58bf-4b75-a11e-9a7b231a629c req-671ad024-652c-4327-8546-d473c533ce0c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.384156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-3896f643-58bf-4b75-a11e-9a7b231a629c req-671ad024-652c-4327-8546-d473c533ce0c service nova] Creating event network-vif-plugged:a2412a97-1a6a-48d8-a7a8-27786cf5d323 for instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 on hv-cinder-83608 Sep 26 05:45:20.397797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-3896f643-58bf-4b75-a11e-9a7b231a629c req-671ad024-652c-4327-8546-d473c533ce0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088410 Sep 26 05:45:20.398762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 85/164] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:45:20.465097 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:20.493782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-cf1df090-6fe8-4e78-9138-b791f4d4e988 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.278877 Sep 26 05:45:20.494980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 80/165] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:20 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:20.638970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:20.639741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:20.646724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.647217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.647650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.648398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.648886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.649417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.753607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:20.754287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:20.760979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.761511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.761978 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.763365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:20.763948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:20.764719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:20.882191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:20.891566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ac6c2da8-879b-4267-acda-10053537868e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.256838 Sep 26 05:45:20.892021 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 86/166] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:20 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:21.015211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:21.031456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2d7fa2f2-de43-47b9-81f4-60f20eb4f9b4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.281358 Sep 26 05:45:21.032636 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 81/167] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:20 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:21.067373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:21.068208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:21.079418 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.084032 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.085537 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:21.087559 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.088459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.089128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:21.233535 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:21.235079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:21.249819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.251069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.252149 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:21.253200 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.253863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.254803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:21.276744 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:21.286429 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-143ba61a-8da5-4c2a-986b-86c8d18f84f6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.223490 Sep 26 05:45:21.287020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 87/168] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:21 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:21.475977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:21.487505 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:21.489446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:21.490797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5356afb8-c524-4fcc-a48e-a25bb63ff60e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.265115 Sep 26 05:45:21.491390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 82/169] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:21 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:21.529325 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:21.530608 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:21.542564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.543445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.544227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:21.545678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.546465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.547214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:21.754100 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:21.768352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-14e2e33e-fc70-46b8-8820-e196a192ad2b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.246454 Sep 26 05:45:21.769451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 88/170] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:21 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:21.919650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:21.920741 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:21.931189 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.931787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.932417 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:21.933284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:21.933865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:21.934368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.068656 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:22.069935 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:22.080416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.081715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.082901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.085199 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.086128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.087536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.107556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:22.133381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:22.142282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2bc1c1cc-0df3-47b3-9378-4c6421a28b33 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.229961 Sep 26 05:45:22.142881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 83/171] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:21 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:22.277618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:22.293282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-39ebe0d5-50ea-4c16-a509-00524ff4adb3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.232028 Sep 26 05:45:22.294341 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 89/172] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:22 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:22.324215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:22.324803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:22.332804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.333487 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.334112 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.335076 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.335564 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.336202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.520250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:22.521102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:22.528114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:22.532503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.533421 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.534428 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.535990 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.537070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.538278 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.540987 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0c764890-bf78-4a95-9bcc-6b83d4378b31 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.220353 Sep 26 05:45:22.542314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 84/173] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:22 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:22.714809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:22.725490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:22.726929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:22.728078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6b578cfe-b5f4-4f68-a7fd-9aca4f90ee9d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.214676 Sep 26 05:45:22.728637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 90/174] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:22 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:22.808785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:22.810042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:22.818245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.819177 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.820323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.821260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:22.821826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:22.822348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:22.988519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:23.001466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-726eb4e3-629f-4976-a8df-d95850d8b8f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.196935 Sep 26 05:45:23.002059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 85/175] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:22 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:23.169335 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:23.169967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:23.178271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.178271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.178271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.178271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.179579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.179579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.319114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:23.319722 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:23.325387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:23.332853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.333385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.333553 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-eed3c589-0f4a-4099-b1c2-40099f102f23 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.170860 Sep 26 05:45:23.334061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 91/176] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:23 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:23.334309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.335017 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.335460 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.335865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.551554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:23.560003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b869a0e6-6f71-43b1-96ec-5d91a63eb8fd tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.244756 Sep 26 05:45:23.560867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 86/177] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:23 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:23.568874 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:23.569993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:23.580822 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.581696 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.582470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.583844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.584616 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.585372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.769489 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:23.770466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:23.779378 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.780311 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.780872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.781765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:23.782367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:23.783286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:23.807101 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:23.822196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-261c1823-19d5-48db-b6cf-bd990414b49a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.261285 Sep 26 05:45:23.823221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 92/178] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:23 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:23.990929 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:24.000005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:24.001562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:24.002739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-407634b4-c661-43a2-8dde-9a4c1e35106f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.238781 Sep 26 05:45:24.003316 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 87/179] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:23 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:24.025001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:24.025691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:24.032380 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.032862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.033344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.034037 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.034480 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.034886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.227413 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:24.236989 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e71ad29b-88e6-4daf-8846-f36f6f2ae062 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.216189 Sep 26 05:45:24.237681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 93/180] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:24 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:24.360842 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:24.361888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:24.369452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.370199 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.370785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.371629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.372255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.372778 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.535997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:24.550373 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d6015068-a283-4b8a-a3db-d9d20293c964 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.194165 Sep 26 05:45:24.561997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 88/181] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:24 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:24.584925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:24.585655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:24.594372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.595274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.595875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.596904 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.597515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.598416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.863536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:24.864431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:24.875792 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.877668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.878098 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.878858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:24.879437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:24.880472 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:24.926916 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:24.945050 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-afe71042-c688-4d90-b7eb-3358be5678d0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.365368 Sep 26 05:45:24.946357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 94/182] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:24 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:25.031391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:25.031998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:25.045651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:25.049822 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:25.050881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:25.059680 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:25.060546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:25.061281 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:25.530612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:25.555468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-87f57258-7809-470b-be5a-38003202393a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.689187 Sep 26 05:45:25.555468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 89/183] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:24 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:25.557678 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:25.559126 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:25.573257 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:25.583188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:25.584071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:25.585319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:25.586087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:25.587121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:25.928298 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:25.947343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:25.950459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:25.952906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cad9c828-1231-4c65-954d-2b0775472616 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.927097 Sep 26 05:45:25.954182 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 95/184] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:25 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:25.963983 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:25.965544 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:25.977196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:25.977959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:25.978674 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:25.982302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:25.982794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:25.983232 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:26.091122 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:26.111602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-474ed999-5840-4145-bec5-820ade3012e4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.553249 Sep 26 05:45:26.113318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 90/185] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:25 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:26.142447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:26.146644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:26.176033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:26.180888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:26.184227 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:26.188345 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:26.193765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:26.197778 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:26.522360 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:26.561059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-600eec84-9044-46b8-acaf-a94e3ac55a2b tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.440951 Sep 26 05:45:26.568661 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 91/186] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:26 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:26.624214 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:26.628695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:26.661972 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:26.676508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:26.681401 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:26.688375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:26.707319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:26.709315 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:26.748977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:26.758768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d1b034e0-28f7-4bb9-8d78-24e17d8ddadd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.802603 Sep 26 05:45:26.765014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 96/187] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:25 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:27.005506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:27.019007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:27.035800 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:27.039862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.041440 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.042628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.044870 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.047789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.048870 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.370063 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:27.384998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-47027d86-d040-4ae4-8aa2-5e2347acca05 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.814562 Sep 26 05:45:27.402847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:27.403911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 92/188] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:26 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:27.416098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:27.421288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:27.422844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6a4c4c45-3043-4629-bd11-8092f68b207c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.438347 Sep 26 05:45:27.436011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:27.437535 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 97/189] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:26 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:27.449447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:27.458342 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-40d91675-e971-448e-9a67-0fe7e947e7d6 req-85230e5a-79e3-43d5-983e-2fda0b78c03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1734960-6d94-4c7b-b6e4-0556d841388b", "tag": "13bc2cea-45a7-43cc-8730-0f8356ec20ea"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:27.490466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.491315 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.493011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.496747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.501350 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.503070 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.522013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-40d91675-e971-448e-9a67-0fe7e947e7d6 req-85230e5a-79e3-43d5-983e-2fda0b78c03e service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.527134 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-40d91675-e971-448e-9a67-0fe7e947e7d6 req-85230e5a-79e3-43d5-983e-2fda0b78c03e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.530580 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-40d91675-e971-448e-9a67-0fe7e947e7d6 req-85230e5a-79e3-43d5-983e-2fda0b78c03e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.569101 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:27.570542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-40d91675-e971-448e-9a67-0fe7e947e7d6 req-85230e5a-79e3-43d5-983e-2fda0b78c03e service nova] Creating event network-changed:13bc2cea-45a7-43cc-8730-0f8356ec20ea for instance c1734960-6d94-4c7b-b6e4-0556d841388b on hv-cinder-83608 Sep 26 05:45:27.582480 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-40d91675-e971-448e-9a67-0fe7e947e7d6 req-85230e5a-79e3-43d5-983e-2fda0b78c03e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140644 Sep 26 05:45:27.584784 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 98/190] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:27.600190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:27.601217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:27.615646 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.616236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.616977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.628034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.628034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.628034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.833198 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:27.846886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-34daf91c-d59c-4a51-a582-707f860d9527 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.437604 Sep 26 05:45:27.847628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 93/191] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:27 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:27.853534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:27.857158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:27.860273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:27.867484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.868059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.872005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.873077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f2756681-ba8a-4c31-9bec-bfc2b79e4452 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.282067 Sep 26 05:45:27.890343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:27.890343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:27.890343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:27.891817 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 99/192] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:27 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:28.097365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:28.108247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-94763650-d478-410f-938a-81d20878e123 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.258102 Sep 26 05:45:28.108870 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 94/193] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:27 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:28.428877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:28.430228 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:28.440515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:28.441734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:28.442564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:28.443743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:28.444597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:28.445263 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:28.487637 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:28.513052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:28.563760 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:28.564903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:28.565724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:28.567239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:28.568091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:28.568848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:28.899797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:28.912384 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:28.915974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:28.918154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e3cd553a-c1f9-43b1-8f50-e07a9fbb56b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.438776 Sep 26 05:45:28.933174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 95/194] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:28 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:28.933174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-83801dfe-8372-46fa-8b37-c2be9ee8a6fb req-fa0f78bb-ffc3-419a-bd57-56653030c60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0853094-da33-4e22-a597-b0df1980229b", "name": "network-vif-plugged", "status": "completed", "tag": "874e44a1-6cb8-479e-b4b0-e68322b26e1f"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:28.946519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-83801dfe-8372-46fa-8b37-c2be9ee8a6fb req-fa0f78bb-ffc3-419a-bd57-56653030c60c service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:28.946519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-83801dfe-8372-46fa-8b37-c2be9ee8a6fb req-fa0f78bb-ffc3-419a-bd57-56653030c60c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:28.946519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-83801dfe-8372-46fa-8b37-c2be9ee8a6fb req-fa0f78bb-ffc3-419a-bd57-56653030c60c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:28.964973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-83801dfe-8372-46fa-8b37-c2be9ee8a6fb req-fa0f78bb-ffc3-419a-bd57-56653030c60c service nova] Creating event network-vif-plugged:874e44a1-6cb8-479e-b4b0-e68322b26e1f for instance a0853094-da33-4e22-a597-b0df1980229b on hv-cinder-83608 Sep 26 05:45:28.973909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-83801dfe-8372-46fa-8b37-c2be9ee8a6fb req-fa0f78bb-ffc3-419a-bd57-56653030c60c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052339 Sep 26 05:45:28.975074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 96/195] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:28.984851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:28.987711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:29.000453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:29.016150 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:29.025084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:29.025775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:29.027366 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:29.028062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:29.028649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:29.029482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-facde629-912a-4335-99ef-3b1a4abdc352 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1322 microversion: 2.1 time: 0.605215 Sep 26 05:45:29.031755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 100/196] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:28 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:29.044258 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:29.046716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:29.058966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:29.060314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:29.061474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:29.063054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:29.064363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:29.065695 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:29.440880 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:29.447721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:29.454175 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d5977220-c49a-475c-8965-5c8b343323af tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.417224 Sep 26 05:45:29.454989 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 101/197] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:29 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:29.468657 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:29.471487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:29.482706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:29.483206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:29.483636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:29.484349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:29.484802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:29.485249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:29.495539 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-052cbd17-8c03-4793-b8f1-a6e38e3a7d21 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.513942 Sep 26 05:45:29.499094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 97/198] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:28 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:29.970791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:29.971939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:30.009723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.010878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.011688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.013207 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.014283 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.015254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.031200 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:30.057278 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c7096c65-0cf3-467e-844b-08aec9e82eda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.599975 Sep 26 05:45:30.069459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 102/199] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:29 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:30.088489 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:30.093571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:30.114539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.117665 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.119136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.121631 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.122473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.123372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.499511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:30.510258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:30.512380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:30.514666 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-72a57296-8459-4548-87ee-394987c071b5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.554013 Sep 26 05:45:30.515341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 98/200] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:29 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:30.525847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:30.525847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:30.531316 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.531944 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.532434 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.533272 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.533804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.534301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.585592 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:30.614845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cd76d776-1dc2-4d54-ad21-e030326f83b1 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1515 microversion: 2.1 time: 0.542169 Sep 26 05:45:30.630823 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 103/201] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:30 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1515 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:30.644090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:30.647748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:30.656854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.657430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.657780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.659963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.660777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.661473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.922285 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:30.930982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-081768b4-1101-43cf-91a7-b491307b9187 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.413358 Sep 26 05:45:30.931685 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 99/202] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:30 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:30.937471 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:30.940316 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:30.947260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.948135 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.948509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:30.949273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:30.949891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:30.950651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.021822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lazy-loading 'flavor' on Instance uuid 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:45:31.182501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-aa4147bd-2655-4378-ad4b-8d1dc5753102 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7/action" status: 200 len: 32 microversion: 2.1 time: 0.249118 Sep 26 05:45:31.183630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 100/203] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:45:30 2022] POST /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:45:31.190475 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:31.191261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:31.201571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.201571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.201571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.201571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.202321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.202321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.416917 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:31.427215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d89616d6-5d8a-4635-b483-19688b55eb5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.794966 Sep 26 05:45:31.430070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 104/204] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:30 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:31.439275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:31.445679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:31.470283 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.472939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.474282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.476135 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.477362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.479412 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.486899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:31.505757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8aff5617-86b1-4508-931c-c6b4be156ea7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.319569 Sep 26 05:45:31.510157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 101/205] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:31 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:31.567405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:31.573355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:31.601689 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.602330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.602841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.603727 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.604263 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.604908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.710435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:31.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4ea18b93-4e77-4ede-8260-486f87699898 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.294720 Sep 26 05:45:31.728592 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 105/206] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:31 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:31.957998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:31.959054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:31.980899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.981641 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.985548 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:31.987192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:31.991585 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:31.996334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:32.017893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:32.043214 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:32.061974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:32.065761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6b54f4d4-9972-4e7c-aadf-c35c3569b107 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.517133 Sep 26 05:45:32.067510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 102/207] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:31 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:32.379020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:32.388883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:32.394123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5c86ce11-74b8-483d-a088-37069a8361f4 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.441854 Sep 26 05:45:32.395745 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 106/208] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:31 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:32.457358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:32.458259 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:32.468629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:32.469707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:32.470438 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:32.471490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:32.472114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:32.472911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:32.534118 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:32.534818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:32.547917 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:32.548515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:32.549096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:32.549938 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:32.550497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:32.551086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:32.770980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:32.780668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c87c50c5-5046-479f-8467-aff4e43e2d1c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.328622 Sep 26 05:45:32.781294 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 103/209] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:32 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:32.792031 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:32.793028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:32.799971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:32.800876 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:32.801563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:32.802644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:32.803321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:32.803948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:32.851110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:32.866373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-453ae6eb-b8e9-4a7b-86a5-732e0981dc4a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.334904 Sep 26 05:45:32.866373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 107/210] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:32 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:33.099212 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:33.099815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:33.109000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.109498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.110685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:33.110685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.115259 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.116482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:33.129772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:33.138099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5bd905e0-017a-40ca-a52c-d7fbc41d9fec tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.355743 Sep 26 05:45:33.140317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 104/211] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:32 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:33.334654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:33.351863 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:33.356002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:33.358489 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9463bd66-8c3e-4589-b026-56d838debdd8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.262906 Sep 26 05:45:33.359527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 108/212] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:33 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:33.422651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:33.424106 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:33.435533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.436424 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.438292 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:33.440033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.446132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.446858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:33.669052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:33.680092 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-252a8ee2-ba45-429b-96d1-02040efc232a tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.265061 Sep 26 05:45:33.681205 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 105/213] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:33 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:33.823542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:33.826217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:33.839122 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.841225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.842240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:33.844033 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.846065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.847367 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:33.888208 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:33.889254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:33.896084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.897045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.897750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:33.898943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:33.899709 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:33.900510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:34.091997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:34.108595 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9065f2cc-8f86-4e33-9683-49f46c45e678 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.224133 Sep 26 05:45:34.110016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 106/214] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:33 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:34.170452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:34.171557 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:34.179914 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:34.186427 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:34.187686 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:34.188610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:34.190181 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:34.191253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:34.192323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:34.193591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8a8e2d11-3d1e-44c1-8af6-a46f82965c50 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.376037 Sep 26 05:45:34.194685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 109/215] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:33 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:34.388695 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:34.389835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:34.406192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:34.406942 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:34.407688 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:34.410571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:34.411321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:34.412147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:34.440976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:34.452132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9c3e5022-ea70-4d25-9117-046aa2a58792 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.290808 Sep 26 05:45:34.454474 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 107/216] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:34 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:34.693018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:34.715873 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:34.716485 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:34.721382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:34.724723 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:34.727085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:34.727248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4329a17e-ae61-4dd7-bfff-f0e2933c796f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.346020 Sep 26 05:45:34.727692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:34.728134 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:34.728855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:34.733940 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:34.734515 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:34.742050 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 110/217] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:34 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:34.955576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:34.958902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:34.969464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d34c1e75-b60b-43a4-b2b1-01ae36b8064e tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.258024 Sep 26 05:45:34.985728 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 108/218] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:34 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:35.134067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:35.134869 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:35.141799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.142371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.142965 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.143699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.144159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.144648 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.241095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:35.242724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:35.255796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.256669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.257354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.258096 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.258549 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.259671 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.335574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:35.356137 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8f51a5a2-d43e-4314-931a-d2d35dd746ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.224851 Sep 26 05:45:35.359454 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 111/219] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:35 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:35.458222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:35.467894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-491e6914-2754-461e-89a0-4e5f4c0b02b4 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.232137 Sep 26 05:45:35.468583 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 109/220] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:35 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:35.514858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:35.516044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:35.527150 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.528873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.530015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.531763 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.532842 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.533922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.769026 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:35.769718 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:35.780105 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:35.784812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.786245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.786245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.787045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:35.787045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:35.787572 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:35.808002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e655eb82-55b8-4963-964a-7e14e40ba140 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.310155 Sep 26 05:45:35.808871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 112/221] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:35 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:35.959789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:35.972177 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:35.974290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:35.975588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-98ada297-25cc-430c-a723-a82bc7dea497 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.210895 Sep 26 05:45:35.976692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 110/222] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:35 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:35.993993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:35.995066 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:36.012241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.012985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.014386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:36.015556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.016214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.018529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:36.205050 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:36.221615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6be105fb-449d-40a9-b8f0-efe07e27e1e3 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.225951 Sep 26 05:45:36.222959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 113/223] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:35 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:36.389290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:36.391309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:36.400494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.401078 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.401526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:36.402247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.402905 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.403337 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:36.517308 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:36.518717 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:36.532054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.533223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.535076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:36.537075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.537909 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.538633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:36.594409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:36.609569 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-076707c5-d1d5-40ac-a6a2-554b9439194e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.225341 Sep 26 05:45:36.626565 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 111/224] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:36 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:36.755340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:36.764720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ccd09d85-71f3-4dbc-b3e8-16d6846d87f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.251465 Sep 26 05:45:36.766595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 114/225] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:36 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:36.856229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:36.857639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:36.867870 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.869021 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.869955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:36.871379 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:36.872354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:36.873046 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.031664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:37.032674 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:37.049521 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.050351 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.051112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.052989 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.054872 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.055876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.094343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:37.120077 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-89a17450-4811-4dbb-9428-0a54501fec9f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.266818 Sep 26 05:45:37.124938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 112/226] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:36 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:37.147825 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-01b4ef47-3941-4a59-a7ea-5765b04ce5f7 req-13371761-f198-4b66-aea8-6910a7702391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9", "name": "network-vif-plugged", "status": "completed", "tag": "f2e668fd-4af3-4593-b411-7b18149bed4b"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:37.198268 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-01b4ef47-3941-4a59-a7ea-5765b04ce5f7 req-13371761-f198-4b66-aea8-6910a7702391 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.200108 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-01b4ef47-3941-4a59-a7ea-5765b04ce5f7 req-13371761-f198-4b66-aea8-6910a7702391 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.202540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-01b4ef47-3941-4a59-a7ea-5765b04ce5f7 req-13371761-f198-4b66-aea8-6910a7702391 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.233571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-01b4ef47-3941-4a59-a7ea-5765b04ce5f7 req-13371761-f198-4b66-aea8-6910a7702391 service nova] Creating event network-vif-plugged:f2e668fd-4af3-4593-b411-7b18149bed4b for instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 on hv-cinder-83608 Sep 26 05:45:37.249440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-01b4ef47-3941-4a59-a7ea-5765b04ce5f7 req-13371761-f198-4b66-aea8-6910a7702391 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118687 Sep 26 05:45:37.250124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 113/227] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:37.265514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:37.267110 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:37.275855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.276931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.277623 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.278870 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.279529 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.280103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.393670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:37.407530 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:37.409906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:37.411516 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b0412331-bf34-4997-9d92-7c189490e038 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.390859 Sep 26 05:45:37.412982 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 115/228] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:37 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:37.563763 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:37.581818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c5837c98-5935-4549-8fcc-e7d3758c4128 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.324445 Sep 26 05:45:37.591807 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 114/229] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:37 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:37.659711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:37.674329 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:37.714394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.718147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.726114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.729449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.730797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.732369 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.810307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:37.814999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:37.830862 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.832058 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.832958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:37.834544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:37.835612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:37.836856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:38.016051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:38.031763 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-970aadfa-dae5-4774-a5c2-ec3113120a1d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.381397 Sep 26 05:45:38.033218 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 116/230] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:37 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:38.135131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:38.146285 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ff17e63d-d8c7-4dfb-8264-466828cb0568 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1363 microversion: 2.1 time: 0.359312 Sep 26 05:45:38.147698 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 115/231] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:37 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1363 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:38.152323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:38.152942 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:38.161576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:38.161996 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:38.162225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:38.163383 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:38.163984 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:38.165370 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:38.422437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:38.436141 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-45ebb4dd-0d78-469e-806f-e5cdb2cb6855 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.289719 Sep 26 05:45:38.437334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 117/232] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:38 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:38.452767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:38.454191 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:38.464213 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:38.464891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:38.465522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:38.466404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:38.467054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:38.467949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:38.630333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:38.631130 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:38.639799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:38.642829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:38.646823 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:38.647883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:38.648487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:38.649054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:38.682339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:38.700144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:38.702933 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:38.705210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-daee9a59-bf85-4653-995f-93557121d39e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.256998 Sep 26 05:45:38.706707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 116/233] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:38 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:38.919408 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:38.935121 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f6f4ee2a-474f-4e6d-9c59-0c781f4196a7 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.316852 Sep 26 05:45:38.936166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 118/234] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:38 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:39.062250 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:39.063465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:39.095155 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:39.099143 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:39.102755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:39.106818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:39.112173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:39.115511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:39.186011 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:39.189453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:39.245222 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:39.246066 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:39.246816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:39.248111 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:39.248888 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:39.257879 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:39.779123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:39.806602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5aeb9faf-c8ce-42dd-9668-d30c25d08d9a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1549 microversion: 2.1 time: 0.626894 Sep 26 05:45:39.810642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 119/235] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:39 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1549 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:39.828752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:39.832289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:39.859220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:39.859764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:39.860211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:39.860955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:39.861479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:39.866421 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:40.016189 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:40.036711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5284e507-790e-4364-9182-67c696bc2cf3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.979621 Sep 26 05:45:40.053219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 117/236] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:39 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:40.059016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:40.059667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:40.075979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:40.076477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:40.076904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:40.077651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:40.078103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:40.078525 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:40.392156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:40.411189 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:40.420598 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:40.423815 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-18d6ee20-6404-4396-a3a4-4294604ff8bf tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.383240 Sep 26 05:45:40.425227 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 118/237] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:40 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:40.436398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:40.445969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-dfb22330-4c71-48a3-b360-8c5f4334a1ff tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.633709 Sep 26 05:45:40.453827 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 120/238] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:39 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:40.459442 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:40.461267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:40.462281 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:40.463175 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:40.475324 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:40.479049 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:40.481163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:40.482582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:40.483439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:40.484206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:40.487737 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:40.490666 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:40.492631 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:40.494507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:40.494999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:40.495459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:40.624184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-aea0ee68-0a01-4336-baab-206e1471525e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.196578 Sep 26 05:45:40.634954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 119/239] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:45:40 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:40.780303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:40.799621 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-32b529d2-a8d3-4599-a47f-8925bca8d8c0 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1314 microversion: 2.1 time: 0.343674 Sep 26 05:45:40.805008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 121/240] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:40 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:41.079873 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:41.083238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:41.110754 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.116748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.117735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.119543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.122951 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.126002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.471039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:41.472083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:41.482530 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.483340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.483919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.484925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.485582 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.486145 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.597983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:41.621917 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-66147b56-11b6-425f-a152-1ef637bad980 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.548787 Sep 26 05:45:41.622905 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 120/241] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:41 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:41.635625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:41.636301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:41.666058 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.666922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.667700 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.669275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.670376 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.671613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.777471 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:41.794525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:41.798581 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:41.801177 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0f5512a9-455c-4fdf-9280-a3cca00194e6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.338041 Sep 26 05:45:41.819215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 122/242] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:41 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:41.858385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:41.859976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:41.872541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.874216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.875536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.877424 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:41.879172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:41.880236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:41.935329 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:42.289764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:42.298313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-39e87b2f-96ca-4b50-9bb3-59f16c093061 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1501 microversion: 2.1 time: 0.470825 Sep 26 05:45:42.298913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 123/243] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:41 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1501 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:42.662149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:42.663020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:42.677700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:42.679028 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:42.679789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:42.683020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:42.683260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:42.686469 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:42.893757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:42.957604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-811c8e98-e6fa-4867-8971-92a30e6d37ef tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 1.327173 Sep 26 05:45:42.958739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 121/244] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:41 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:43.002581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:43.015705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:43.055028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:43.064836 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:43.066080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:43.067748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:43.069982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:43.076497 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:43.163526 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:43.184404 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-bb148400-32d9-400c-a318-7c67ab0eb39d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.528108 Sep 26 05:45:43.189204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 124/245] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:42 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:43.546212 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ea297453-865b-4423-8d37-124aa1021e90 req-7ecac674-81bb-494d-8abb-9b914266556e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1734960-6d94-4c7b-b6e4-0556d841388b", "name": "network-vif-plugged", "status": "completed", "tag": "13bc2cea-45a7-43cc-8730-0f8356ec20ea"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:43.572647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ea297453-865b-4423-8d37-124aa1021e90 req-7ecac674-81bb-494d-8abb-9b914266556e service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:43.573487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ea297453-865b-4423-8d37-124aa1021e90 req-7ecac674-81bb-494d-8abb-9b914266556e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:43.574434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ea297453-865b-4423-8d37-124aa1021e90 req-7ecac674-81bb-494d-8abb-9b914266556e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:43.594864 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ea297453-865b-4423-8d37-124aa1021e90 req-7ecac674-81bb-494d-8abb-9b914266556e service nova] Creating event network-vif-plugged:13bc2cea-45a7-43cc-8730-0f8356ec20ea for instance c1734960-6d94-4c7b-b6e4-0556d841388b on hv-cinder-83608 Sep 26 05:45:43.603733 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ea297453-865b-4423-8d37-124aa1021e90 req-7ecac674-81bb-494d-8abb-9b914266556e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062185 Sep 26 05:45:43.605589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 125/246] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:43.987952 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:44.005172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:44.006204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:44.010700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:44.011242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:44.012803 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:44.013546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:44.017344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:44.141966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:44.183716 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:44.187530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:44.190295 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bfea9697-d5a6-4200-ace8-8621843d2da6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 1.229581 Sep 26 05:45:44.193167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 122/247] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:42 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:44.209665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07219500-974c-4b57-8f70-0b03022d9d64"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:44.217774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:44.246645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:44.247516 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:44.248517 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:44.250158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:44.251462 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:44.252420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:44.365934 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:44.385889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ffdd5a69-a01c-496d-b596-41a37d3008bd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.404086 Sep 26 05:45:44.393999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 126/248] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:43 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:44.416596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:44.426669 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:44.442621 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:44.444412 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:44.446895 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:44.448407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:44.450094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:44.451206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:44.746605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:44.756334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b655834d-1789-40a4-b4eb-8a4cc24a0c81 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.358668 Sep 26 05:45:44.757513 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 127/249] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:44 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:44.928919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-3f681b37-dd8a-448e-b13d-cbdf6d750a37 req-9573b8c5-c757-47a0-ac5c-f10dbfa8df05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0853094-da33-4e22-a597-b0df1980229b", "tag": "874e44a1-6cb8-479e-b4b0-e68322b26e1f"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:44.940815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-3f681b37-dd8a-448e-b13d-cbdf6d750a37 req-9573b8c5-c757-47a0-ac5c-f10dbfa8df05 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:44.941583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-3f681b37-dd8a-448e-b13d-cbdf6d750a37 req-9573b8c5-c757-47a0-ac5c-f10dbfa8df05 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:44.942253 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-3f681b37-dd8a-448e-b13d-cbdf6d750a37 req-9573b8c5-c757-47a0-ac5c-f10dbfa8df05 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:44.955985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-3f681b37-dd8a-448e-b13d-cbdf6d750a37 req-9573b8c5-c757-47a0-ac5c-f10dbfa8df05 service nova] Creating event network-changed:874e44a1-6cb8-479e-b4b0-e68322b26e1f for instance a0853094-da33-4e22-a597-b0df1980229b on hv-cinder-83608 Sep 26 05:45:44.963026 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-3f681b37-dd8a-448e-b13d-cbdf6d750a37 req-9573b8c5-c757-47a0-ac5c-f10dbfa8df05 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038347 Sep 26 05:45:44.964518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 128/250] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:45.249384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:45.252261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:45.269351 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:45.270946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:45.272000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:45.275822 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:45.277434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:45.278308 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:45.561866 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:45.573363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:45.575756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:45.577291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-37e213a6-5110-4c09-90f4-522091738c04 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1408 microversion: 2.20 time: 0.338130 Sep 26 05:45:45.578761 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 129/251] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:45 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:45:45.584798 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:45.585846 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:45.593992 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:45.594828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:45.595456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:45.596379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:45.597038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:45.597884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:45.703957 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b6cdb41b-197b-458c-a0d1-9c5575fea177 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "POST /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.507586 Sep 26 05:45:45.704930 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 123/252] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:45:44 2022] POST /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9/os-volume_attachments => generated 194 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:45.711109 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-4e1e94f3-2c75-48f2-8fcc-849b751c198c req-3313299e-1546-49a4-a203-b96854ff6ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea993d78-323c-4565-9a8e-db170bd7954a", "name": "network-vif-plugged", "status": "completed", "tag": "6f3cd267-47c3-4bd9-9283-70669f0b6b2c"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:45.727733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-4e1e94f3-2c75-48f2-8fcc-849b751c198c req-3313299e-1546-49a4-a203-b96854ff6ae8 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:45.728204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-4e1e94f3-2c75-48f2-8fcc-849b751c198c req-3313299e-1546-49a4-a203-b96854ff6ae8 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:45.728623 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-4e1e94f3-2c75-48f2-8fcc-849b751c198c req-3313299e-1546-49a4-a203-b96854ff6ae8 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:45.756339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-4e1e94f3-2c75-48f2-8fcc-849b751c198c req-3313299e-1546-49a4-a203-b96854ff6ae8 service nova] Creating event network-vif-plugged:6f3cd267-47c3-4bd9-9283-70669f0b6b2c for instance ea993d78-323c-4565-9a8e-db170bd7954a on hv-cinder-83608 Sep 26 05:45:45.773017 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-4e1e94f3-2c75-48f2-8fcc-849b751c198c req-3313299e-1546-49a4-a203-b96854ff6ae8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066475 Sep 26 05:45:45.773726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 124/253] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:45.798597 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:45.799777 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:45.807012 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:45.823869 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:45.824665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:45.825290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:45.826171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:45.826784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:45.827485 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:45.849497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:45.863831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-93085add-1e91-47ef-a923-e5e185bcbe62 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.282930 Sep 26 05:45:45.864694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 130/254] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:45 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:46.051167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:46.059031 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:46.061891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-78cf4c19-3d1f-4674-a3da-7b9b0c136a5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.267903 Sep 26 05:45:46.062803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 125/255] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:45 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:46.608060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:46.608663 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:46.619462 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:46.620105 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:46.620386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:46.621122 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:46.621770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:46.622064 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:46.864312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:46.875325 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:46.876825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:46.878085 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-bf5e8630-d1dd-4d79-abd0-7d5f7e7446fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1599 microversion: 2.20 time: 0.274011 Sep 26 05:45:46.879219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 131/256] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:45:46 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1599 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:45:46.918323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:46.919017 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:46.923321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:46.928890 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:46.940126 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:46.940630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:46.941064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:46.941875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:46.942331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:46.945373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:46.945872 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:46.946300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:46.947027 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:46.947490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:46.947908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:46.949489 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:47.106900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4d631c5d-8dba-4e56-a6f5-3b0dc919488a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.192384 Sep 26 05:45:47.107507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 132/257] 10.222.0.57 () {60 vars in 1316 bytes} [Mon Sep 26 05:45:46 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:45:47.125492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:47.126124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:47.140405 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:47.140900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:47.141404 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:47.142256 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:47.142714 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:47.143318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:47.357192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:47.373293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f0b8caee-2dd4-4fd9-807e-bfe843fda515 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.467807 Sep 26 05:45:47.374440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 126/258] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:46 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:47.522150 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:47.539327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b26dce5b-2ecd-4632-b9c5-e588d434595f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.428595 Sep 26 05:45:47.541672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 133/259] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:47 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:48.399841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:48.401290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:48.412646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:48.412646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:48.413273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:48.414775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:48.415624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:48.416237 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:48.576790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:48.578088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:48.578273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:48.585185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:48.585748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:48.586734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:48.587674 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:48.588204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:48.588839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:48.590290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e8b6cf22-735a-424b-b843-9885c66a73b0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.196057 Sep 26 05:45:48.591102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 127/260] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:48 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:48.919546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:48.928031 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e189cb60-5cae-450d-8abf-fc599306b8b4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.355243 Sep 26 05:45:48.928632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 134/261] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:48 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:49.065913 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-ef0499be-708c-40c4-b7bd-a2f53f529f04 req-2e9264a1-469a-46fa-b044-8118131c3c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1734960-6d94-4c7b-b6e4-0556d841388b", "tag": "13bc2cea-45a7-43cc-8730-0f8356ec20ea"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:49.076850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-ef0499be-708c-40c4-b7bd-a2f53f529f04 req-2e9264a1-469a-46fa-b044-8118131c3c84 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:49.077383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-ef0499be-708c-40c4-b7bd-a2f53f529f04 req-2e9264a1-469a-46fa-b044-8118131c3c84 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:49.077795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-ef0499be-708c-40c4-b7bd-a2f53f529f04 req-2e9264a1-469a-46fa-b044-8118131c3c84 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:49.091269 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-ef0499be-708c-40c4-b7bd-a2f53f529f04 req-2e9264a1-469a-46fa-b044-8118131c3c84 service nova] Creating event network-changed:13bc2cea-45a7-43cc-8730-0f8356ec20ea for instance c1734960-6d94-4c7b-b6e4-0556d841388b on hv-cinder-83608 Sep 26 05:45:49.097125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-ef0499be-708c-40c4-b7bd-a2f53f529f04 req-2e9264a1-469a-46fa-b044-8118131c3c84 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035981 Sep 26 05:45:49.098011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 128/262] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:45:49.619132 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:49.620007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:49.627742 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:49.628550 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:49.629284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:49.630266 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:49.631064 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:49.631583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:49.843204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:49.852826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f92dc477-2c76-4a05-b78d-eb54f5b65a3a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.238555 Sep 26 05:45:49.853985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 135/263] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:49 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:49.952993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:49.954344 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:49.964060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:49.964652 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:49.965201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:49.966062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:49.966689 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:49.967248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:50.156703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:50.169724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-07bd9cb4-52d5-4d93-912e-7e7e1f615c5e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.221530 Sep 26 05:45:50.171266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 129/264] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:49 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:50.890641 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:50.891288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:50.898488 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:50.898968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:50.899558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:50.900271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:50.900727 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:50.901184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:51.064758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:51.078318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d09f99c6-d19b-4ba2-9846-784958848cb0 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.191221 Sep 26 05:45:51.079281 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 136/265] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:50 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:51.199187 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:51.199946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:51.207282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:51.207840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:51.208272 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:51.209289 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:51.209850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:51.210284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:51.370767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:51.385185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-13f03272-6459-45f7-905e-4404f5fc6106 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.189854 Sep 26 05:45:51.386976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 130/266] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:51 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:52.104387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:52.105071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:52.111889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:52.112441 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:52.112875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:52.113661 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:52.114107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:52.114538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:52.275472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:52.285074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fbf602c2-a427-4bd6-99f1-4c21085d6688 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.184326 Sep 26 05:45:52.285719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 137/267] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:52 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:52.427693 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:52.428756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:52.438100 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:52.438636 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:52.439068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:52.439919 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:52.440380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:52.440809 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:52.611464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:52.625893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-221d8c05-7430-43b0-9d0d-35387278bf97 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1368 microversion: 2.1 time: 0.203008 Sep 26 05:45:52.626949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 131/268] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:52 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:53.309598 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:53.310214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:53.319474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:53.320406 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:53.320760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:53.321514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:53.324590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:53.326147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:53.538635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:53.553900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-73d1afd2-ce01-482a-841e-994705c12644 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.249310 Sep 26 05:45:53.555456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 138/269] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:53 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:53.663954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:53.664674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:53.672606 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:53.673163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:53.673617 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:53.674391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:53.674854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:53.675277 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:53.888032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:53.896368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3bebb9f4-d71a-4714-8b0b-adeed0b12619 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1557 microversion: 2.1 time: 0.236494 Sep 26 05:45:53.896955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 132/270] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:53 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1557 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:45:53.927601 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:53.928083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:53.934414 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:53.934906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:53.935354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:53.936037 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:53.936573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:53.936911 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:54.064576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4b729952-35bb-4e4d-af39-13b4615aa53f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140890 Sep 26 05:45:54.065482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 139/271] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:45:53 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:54.579531 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:54.580299 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:54.589188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:54.589983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:54.590519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:54.592097 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:54.593197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:54.593868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:55.209910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:55.223818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ab11cfaf-d19e-48d5-b061-04612b138f68 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.648017 Sep 26 05:45:55.246060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 133/272] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:54 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:56.004593 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-7e9e3ba3-4edd-4db7-9a32-788c6d06d7d8 req-1f863f43-359c-445d-afd3-7fcd21ec738a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea993d78-323c-4565-9a8e-db170bd7954a", "tag": "6f3cd267-47c3-4bd9-9283-70669f0b6b2c"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:45:56.020125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-7e9e3ba3-4edd-4db7-9a32-788c6d06d7d8 req-1f863f43-359c-445d-afd3-7fcd21ec738a service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:56.020859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-7e9e3ba3-4edd-4db7-9a32-788c6d06d7d8 req-1f863f43-359c-445d-afd3-7fcd21ec738a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:56.021443 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-7e9e3ba3-4edd-4db7-9a32-788c6d06d7d8 req-1f863f43-359c-445d-afd3-7fcd21ec738a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:56.040868 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-7e9e3ba3-4edd-4db7-9a32-788c6d06d7d8 req-1f863f43-359c-445d-afd3-7fcd21ec738a service nova] Creating event network-changed:6f3cd267-47c3-4bd9-9283-70669f0b6b2c for instance ea993d78-323c-4565-9a8e-db170bd7954a on hv-cinder-83608 Sep 26 05:45:56.048420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-7e9e3ba3-4edd-4db7-9a32-788c6d06d7d8 req-1f863f43-359c-445d-afd3-7fcd21ec738a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050490 Sep 26 05:45:56.049328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 140/273] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:45:56.273169 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:56.275971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:56.294161 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:56.295419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:56.296500 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:56.298204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:56.300683 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:56.302021 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:56.742349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:56.750946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-80339a0b-74f0-465b-bd90-03ffbdc86f48 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.487629 Sep 26 05:45:56.751871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 134/274] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:56 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:57.798337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:57.799182 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:57.809125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=88 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:57.812415 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:57.813503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:57.814904 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:57.817266 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:57.818445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:57.819527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:58.387328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:58.408110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-35b97d13-6b29-4645-b50d-de26ceadd950 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.622541 Sep 26 05:45:58.410678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 141/275] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:57 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:45:59.461907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:45:59.462949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:45:59.474548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:59.475615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:59.476290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:59.477454 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:45:59.478219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:45:59.478721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:45:59.701277 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:45:59.714648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9366b992-d46f-4602-81b3-43f303fc20c7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.261742 Sep 26 05:45:59.715736 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 135/276] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:45:59 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:00.741275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:00.742147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:00.750644 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:00.751285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:00.751831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:00.752651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:00.753703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:00.754237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:01.046799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:01.049975 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:01.064579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-21d67ac5-1465-4afd-8bc2-66438090201d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.327379 Sep 26 05:46:01.066083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 142/277] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:00 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:02.112743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:02.115403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:02.126860 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:02.128378 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:02.130162 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:02.131171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:02.131826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:02.133076 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:02.405322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:02.414369 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-11a87a25-baf9-4e37-9d3a-41884692aeea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.308447 Sep 26 05:46:02.415543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 136/278] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:02 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:02.536831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:02.537716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:02.554506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:02.555154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:02.555709 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:02.556542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:02.557594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:02.558248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:02.593284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:46:02.702801 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5969f72c-3414-4ec8-9634-ee043a897677 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 204 len: 0 microversion: 2.1 time: 0.170056 Sep 26 05:46:02.703522 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 143/279] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:46:02 2022] DELETE /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:46:02.714285 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:02.714905 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:02.723895 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:02.723895 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:02.723895 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:02.724490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:02.724641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:02.724978 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:02.884079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:02.894533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b181ccb8-f0b1-4a69-9f10-2a2c7e9fe143 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1553 microversion: 2.1 time: 0.186160 Sep 26 05:46:02.895376 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 137/280] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:02 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:03.338949 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-475066026", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "networks": [{"uuid": "d84453e4-a1e7-4567-8843-35b115b62bbb"}]}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:03.398354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] validate_networks() for [('d84453e4-a1e7-4567-8843-35b115b62bbb', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:46:03.456872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:03.458256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:03.469624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:03.470798 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:03.471560 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:03.473212 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:03.474035 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:03.475027 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:03.685845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:03.699261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a396a71c-7f93-4d99-860e-5ba35e136bd4 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.247421 Sep 26 05:46:03.700282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 138/281] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:03 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:03.922547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:03.923397 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:03.930003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:03.930465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:03.930924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:03.931644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:03.932093 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:03.932511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:03.968110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:46:03.968918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:46:03.969291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:46:03.969613 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:46:03.969933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:46:03.981289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:03.981780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:03.982287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:03.983018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:03.983469 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:03.983881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:04.005067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Getting quotas for project ee638507f9b0415f94f7c54e0e3db8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:46:04.012294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Getting quotas for user 04c7152003c4491abea8305c26f366ed and project ee638507f9b0415f94f7c54e0e3db8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:46:04.025889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:46:04.029192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:46:04.085094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a4487356-08a2-4166-8246-837a66d69c6d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751676 Sep 26 05:46:04.086057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 144/282] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 05:46:04.098230 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fb1b2f35-3bd4-469d-921a-c4de8453e7c2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:04.098845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fb1b2f35-3bd4-469d-921a-c4de8453e7c2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:04.186890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:04.187220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-fb1b2f35-3bd4-469d-921a-c4de8453e7c2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:04.196852 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3982556e-00bc-4c25-80ba-078b15137c85 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1553 microversion: 2.1 time: 0.278963 Sep 26 05:46:04.213704 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 139/283] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:03 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:04.218649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fb1b2f35-3bd4-469d-921a-c4de8453e7c2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1213 microversion: 2.1 time: 0.124321 Sep 26 05:46:04.220240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 145/284] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:04 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:04.738172 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:04.739133 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:04.749256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:04.750269 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:04.751125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:04.752318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:04.753640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:04.754511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:04.989475 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:04.997850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-209cc2d6-f661-478f-8768-1df55373023d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.264991 Sep 26 05:46:04.998466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 140/285] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:04 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:05.234372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:05.244817 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:05.250753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:05.252898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:05.258010 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:05.260722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:05.262240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:05.263886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:05.264997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:05.265945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:05.266781 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:05.267785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:05.268710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:05.270559 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:05.271474 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:05.273232 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:05.436042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:05.445059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ed0acc69-c536-440c-a9ed-6382a196de34 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1217 microversion: 2.1 time: 0.204636 Sep 26 05:46:05.446354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 141/286] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:05 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1217 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:05.527197 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:05.538821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c7d1b23e-0b56-4c5b-a660-be0ae47a5237 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1553 microversion: 2.1 time: 0.316449 Sep 26 05:46:05.540478 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 146/287] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:05 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1553 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:06.028351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:06.034095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:06.063133 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:06.073897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:06.074955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:06.078400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:06.080556 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:06.081462 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:06.157229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-f069ee91-b2f1-4eae-87b5-9cdf0177f170 req-31d49588-d425-43c7-a8dc-f6542285a8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9", "name": "network-vif-deleted", "tag": "f2e668fd-4af3-4593-b411-7b18149bed4b"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:06.172592 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-f069ee91-b2f1-4eae-87b5-9cdf0177f170 req-31d49588-d425-43c7-a8dc-f6542285a8e1 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:06.179931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-f069ee91-b2f1-4eae-87b5-9cdf0177f170 req-31d49588-d425-43c7-a8dc-f6542285a8e1 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:06.179931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-f069ee91-b2f1-4eae-87b5-9cdf0177f170 req-31d49588-d425-43c7-a8dc-f6542285a8e1 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:06.191138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-f069ee91-b2f1-4eae-87b5-9cdf0177f170 req-31d49588-d425-43c7-a8dc-f6542285a8e1 service nova] Creating event network-vif-deleted:f2e668fd-4af3-4593-b411-7b18149bed4b for instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 on hv-cinder-83608 Sep 26 05:46:06.197846 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-f069ee91-b2f1-4eae-87b5-9cdf0177f170 req-31d49588-d425-43c7-a8dc-f6542285a8e1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044526 Sep 26 05:46:06.198592 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 147/288] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:46:06.383443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:06.398306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ea2a8b28-6b33-4820-b10e-855f7b0cdfc3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.378311 Sep 26 05:46:06.413360 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 142/289] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:06 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:06.484748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:06.485837 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:06.495497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:06.496241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:06.497261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:06.498190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:06.499025 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:06.499587 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:06.580575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:06.581726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:06.593705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:06.594586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:06.595356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:06.596635 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:06.597580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:06.598357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:06.606940 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:06.618932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:06.637168 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c92b5eee-2476-4956-99a9-9fdf65429cc0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1265 microversion: 2.1 time: 0.158194 Sep 26 05:46:06.638243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 148/290] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:06 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:06.720548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:06.737275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bcf2ef77-146e-4f3b-a1ac-a700d0511a35 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1511 microversion: 2.1 time: 0.163517 Sep 26 05:46:06.738717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 143/291] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:06 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:07.437484 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:07.438335 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:07.448349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:07.449175 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:07.450078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:07.462671 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:07.463181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:07.463627 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:07.676381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:07.677751 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:07.691386 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:07.693621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:07.695750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:07.696844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:07.697570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:07.698002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:07.745234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:07.756061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-20c0b0cc-50ea-413f-be20-ec9a75c50544 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.323767 Sep 26 05:46:07.756678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 149/292] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:07 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:07.775309 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:07.776708 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:07.788975 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:07.791463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:07.796755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:07.797666 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:07.799090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:07.802135 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:07.802931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:07.809845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e2cafcfe-eded-4044-9bf3-94d8c6a28014 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1265 microversion: 2.1 time: 0.138998 Sep 26 05:46:07.811035 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 144/293] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:07 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:07.898200 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:07.908869 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0f8cafc1-70c3-4614-810e-cce7e3eb5019 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1345 microversion: 2.1 time: 0.137774 Sep 26 05:46:07.909343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 150/294] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:07 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:08.801308 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:08.802045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:08.809662 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:08.810463 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:08.811100 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:08.812148 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:08.812680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:08.813204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:08.847656 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:08.849050 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:08.857287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:08.858541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:08.859208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:08.860124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:08.860793 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:08.861421 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:08.970393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:08.980379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-34097d48-af8b-40aa-88b6-e94dc98dd3dd tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1273 microversion: 2.1 time: 0.137121 Sep 26 05:46:08.994459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 151/295] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:08 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:09.005412 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:09.007254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:09.018700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:09.019649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:09.020099 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:09.021546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:09.021546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:09.022310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:09.098497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:09.099805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:09.100720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:09.101771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lazy-loading 'fault' on Instance uuid 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:09.155598 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:09.164695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a2529e91-d5b4-4205-b837-69e35967cd11 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1521 microversion: 2.1 time: 0.373149 Sep 26 05:46:09.165683 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 145/296] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:08 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:09.199270 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:09.208679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e7d26d26-e881-4119-b267-9e5e62a22533 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1350 microversion: 2.1 time: 0.212191 Sep 26 05:46:09.209520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 152/297] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:08 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1350 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:10.008153 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:10.017424 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:10.025662 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.026538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.027178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.028157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.028851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.029528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.118938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:10.147039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-486a404e-6a56-43ea-9cef-06d9627ac167 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1271 microversion: 2.1 time: 0.145985 Sep 26 05:46:10.149909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 146/298] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:09 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:10.204717 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:10.206242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:10.233182 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.234422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.258932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.264520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.266697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:10.267626 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:10.270004 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.270543 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.291587 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.293612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.294618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.296144 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.297419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.307113 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.675630 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:10.688519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a89e75cc-e510-49ce-82ce-4fe71381352f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1501 microversion: 2.1 time: 0.493087 Sep 26 05:46:10.689191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 153/299] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:10 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1501 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:10.696627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.698320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.699296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.699943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lazy-loading 'fault' on Instance uuid 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:10.735018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:10.736562 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:10.745901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.746967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.747426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.748156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:10.748615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:10.749082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:10.835667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3842855395b47a5adc10c7480b5a4ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7edddf22ec7f41aea66bcf3e30a3d3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:10.852357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-acdd604d-51f0-478b-bc68-326fbd5286cc tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 200 len: 1350 microversion: 2.1 time: 0.597244 Sep 26 05:46:10.853439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 147/300] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:10 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 1350 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:11.001770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:11.022308 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f5404e3b-3176-4eaf-834f-8cbf4ff073ed tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1514 microversion: 2.1 time: 0.285624 Sep 26 05:46:11.033530 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 154/301] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:10 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:11.183785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:11.184588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:11.200317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:11.202982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:11.204690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:11.206541 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:11.209076 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:11.210274 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:11.775746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:11.784354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-52d41902-35ff-49be-918b-73ba6aca3bfa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.604934 Sep 26 05:46:11.789154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 148/302] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:11 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:11.898510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:11.899619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:11.915878 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:11.916721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:11.917532 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:11.918802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:11.919686 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:11.920453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:11.953376 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] HTTP exception thrown: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Request method failure captured: Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 HTTP/1.1 Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTxAq-J6Q_K75wTpNM8vEDvckX6nkjiZOiXeTZo3OT4WQUNtXOcdQZAZSGgYne5j3RR5xPWT1nzjkISyo0fdlEUWwZ8is-465HGMNYxDvmb67m3CEJI51uzu0kq55SGSHEHo8Om9i2yxPrSrpreUsHwMWCTd6uf6bEaBLQyUHP9QWEY Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:46:11.971770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7edddf22ec7f41aea66bcf3e30a3d3ca", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: d3842855395b47a5adc10c7480b5a4ca Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:11.974049 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9'} Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:46:11.975098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:11.976790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:11.981348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Returning 404 to user: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:46:11.981348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b73093f8-9652-4a70-b8a9-7f3bf4c427b6 tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 404 len: 111 microversion: 2.1 time: 0.087894 Sep 26 05:46:11.981348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 155/303] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:11 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:46:12.150106 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:12.154162 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:12.165236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.166130 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.166901 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.168142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.168965 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.169743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.195074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] HTTP exception thrown: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Request method failure captured: Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9/os-volume_attachments HTTP/1.1 Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTxAq-J6Q_K75wTpNM8vEDvckX6nkjiZOiXeTZo3OT4WQUNtXOcdQZAZSGgYne5j3RR5xPWT1nzjkISyo0fdlEUWwZ8is-465HGMNYxDvmb67m3CEJI51uzu0kq55SGSHEHo8Om9i2yxPrSrpreUsHwMWCTd6uf6bEaBLQyUHP9QWEY Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:46:12.203254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7edddf22ec7f41aea66bcf3e30a3d3ca", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: d3842855395b47a5adc10c7480b5a4ca Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:12.204616 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'server_id': '1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9'} Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:46:12.205490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:12.206668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:12.207946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Returning 404 to user: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:46:12.207946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-572a9d87-ad2e-4400-9271-6607322e318f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063449 Sep 26 05:46:12.212724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 149/304] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:46:12 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:46:12.251144 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ddae6d9a-39cf-4b4f-b6ca-622aa53d98bc req-f71c1476-bd7b-4651-8a6b-170b0e7c2c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e", "tag": "78fc4bee-4c52-43f2-ac5c-5978d96703c2"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:12.275665 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ddae6d9a-39cf-4b4f-b6ca-622aa53d98bc req-f71c1476-bd7b-4651-8a6b-170b0e7c2c5a service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.276203 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ddae6d9a-39cf-4b4f-b6ca-622aa53d98bc req-f71c1476-bd7b-4651-8a6b-170b0e7c2c5a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.276818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ddae6d9a-39cf-4b4f-b6ca-622aa53d98bc req-f71c1476-bd7b-4651-8a6b-170b0e7c2c5a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.310246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ddae6d9a-39cf-4b4f-b6ca-622aa53d98bc req-f71c1476-bd7b-4651-8a6b-170b0e7c2c5a service nova] Creating event network-changed:78fc4bee-4c52-43f2-ac5c-5978d96703c2 for instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e on hv-cinder-83608 Sep 26 05:46:12.322092 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ddae6d9a-39cf-4b4f-b6ca-622aa53d98bc req-f71c1476-bd7b-4651-8a6b-170b0e7c2c5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081522 Sep 26 05:46:12.323904 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 156/305] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:12.715106 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:12.718398 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:12.725772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.726795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.727276 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.728002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.728461 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.728912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.754824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lazy-loading 'flavor' on Instance uuid 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:12.814390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:12.815710 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:12.826005 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.826504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.826933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.828510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.828977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.829460 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.901694 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4d327ac9-cde4-461e-82ec-e764ff0e96d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc/action" status: 200 len: 32 microversion: 2.1 time: 0.192547 Sep 26 05:46:12.903275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 150/306] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:46:12 2022] POST /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:46:12.917701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:12.919062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:12.928779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.929690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.930395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:12.931618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:12.932186 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:12.932713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:13.065053 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:13.073894 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8a82e8f1-04ad-4635-b403-9824b0c54ac6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.265583 Sep 26 05:46:13.074904 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 157/307] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:12 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:13.142122 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:13.159482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-36edb541-042b-4b92-9089-628fbf3dc896 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.246269 Sep 26 05:46:13.160943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 151/308] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:12 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:13.696791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:13.697312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:13.704081 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:13.704717 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:13.705378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:13.706088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:13.706582 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:13.707057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:13.724378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] HTTP exception thrown: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Request method failure captured: Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: DELETE /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 HTTP/1.1 Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTxAq-J6Q_K75wTpNM8vEDvckX6nkjiZOiXeTZo3OT4WQUNtXOcdQZAZSGgYne5j3RR5xPWT1nzjkISyo0fdlEUWwZ8is-465HGMNYxDvmb67m3CEJI51uzu0kq55SGSHEHo8Om9i2yxPrSrpreUsHwMWCTd6uf6bEaBLQyUHP9QWEY Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:46:13.726148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7edddf22ec7f41aea66bcf3e30a3d3ca", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: d3842855395b47a5adc10c7480b5a4ca Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.727735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9'} Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:46:13.728538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.729650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.730963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Returning 404 to user: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:46:13.730963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-503d20d8-daae-4a69-9d3b-39369cdc890c tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 404 len: 111 microversion: 2.1 time: 0.034793 Sep 26 05:46:13.730963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 158/309] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:46:13 2022] DELETE /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:46:13.738339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:13.739348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] [instance: 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:13.746789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:13.747381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:13.747820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:13.748731 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:13.749263 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:13.749677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:13.766015 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] HTTP exception thrown: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Request method failure captured: Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 HTTP/1.1 Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTxAq-J6Q_K75wTpNM8vEDvckX6nkjiZOiXeTZo3OT4WQUNtXOcdQZAZSGgYne5j3RR5xPWT1nzjkISyo0fdlEUWwZ8is-465HGMNYxDvmb67m3CEJI51uzu0kq55SGSHEHo8Om9i2yxPrSrpreUsHwMWCTd6uf6bEaBLQyUHP9QWEY Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:46:13.768431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7edddf22ec7f41aea66bcf3e30a3d3ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7edddf22ec7f41aea66bcf3e30a3d3ca", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 7edddf22ec7f41aea66bcf3e30a3d3ca Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-DeleteServersTestJSON-606749681 Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: d3842855395b47a5adc10c7480b5a4ca Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-DeleteServersTestJSON-606749681-project Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.771084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9'} Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:46:13.772347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. Sep 26 05:46:13.773737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:13.774979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] Returning 404 to user: Instance 1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:46:13.774979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4064edef-50b5-430b-b51c-40281c7a184f tempest-DeleteServersTestJSON-606749681 tempest-DeleteServersTestJSON-606749681-project] 10.222.0.57 "GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9" status: 404 len: 111 microversion: 2.1 time: 0.035799 Sep 26 05:46:13.774979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 152/310] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:13 2022] GET /compute/v2.1/servers/1b9136ba-c4dc-4ae1-8d0e-3db442e7a5b9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:46:14.105095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:14.108729 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:14.123527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:14.135373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:14.137216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:14.139073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:14.142169 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:14.144524 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:14.145791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:14.167459 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1426783319", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:14.210348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=8 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:14.243828 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] validate_networks() for None {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:46:14.592575 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:14.606680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:46:14.607579 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:46:14.608596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:46:14.609599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:46:14.610478 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:46:14.617707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8c31a6dd-e876-4506-9d6e-fe1741d9ad54 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.516391 Sep 26 05:46:14.623109 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 159/311] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:14 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:14.626958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:14.627727 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:14.628423 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:14.629468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:14.630119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:14.630752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:14.633907 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:14.637497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:14.651618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:14.652611 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:14.653269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:14.654536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:14.655398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:14.655979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Getting quotas for project 9c05c9127854481aa2ff754f336e7895. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:46:14.656354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:14.661282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Getting quotas for user 97028c1b3fe141dea0fa530a4b8aff30 and project 9c05c9127854481aa2ff754f336e7895. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:46:14.685559 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:46:14.688439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:46:14.750735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d9d8a970-0566-4d21-9fd4-397a0bf03792 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587983 Sep 26 05:46:14.751814 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 153/312] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:46:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 05:46:14.780226 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-101ec5f1-2cc7-4e7a-94a5-4ba1915f5064 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:14.781347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-101ec5f1-2cc7-4e7a-94a5-4ba1915f5064 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:14.880841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-101ec5f1-2cc7-4e7a-94a5-4ba1915f5064 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:14.895270 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-101ec5f1-2cc7-4e7a-94a5-4ba1915f5064 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1215 microversion: 2.1 time: 0.129380 Sep 26 05:46:14.896956 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 154/313] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:14 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:15.020284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:15.030402 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b33b2e8c-7a98-4e34-9251-26d3ebc35f61 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.405357 Sep 26 05:46:15.030966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 160/314] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:14 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:15.673863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:15.674999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:15.687666 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:15.688803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:15.689563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:15.691582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:15.692493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:15.693385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:15.925274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:15.927562 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:15.946774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:15.947974 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:15.948837 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:15.952585 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:15.953073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:15.953548 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:15.954638 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:15.976219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-adfdf3bc-2a99-4380-8f6c-e555c1380263 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.306615 Sep 26 05:46:15.983451 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 155/315] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:15 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:16.059146 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:16.061826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:16.064400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:16.073041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:16.073875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:16.074602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:16.083288 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:16.084188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:16.085015 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:16.111975 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:16.114495 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:16.127555 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0c6a8d57-86eb-4a99-91b5-01cb341eb99a tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1219 microversion: 2.1 time: 0.206275 Sep 26 05:46:16.133417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 161/316] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:15 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:16.343202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:16.363138 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d315b9b2-b476-4854-a8ed-9237b5985a2a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.309712 Sep 26 05:46:16.364084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 156/317] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:16 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:17.002021 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:17.004004 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:17.019410 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:17.020083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:17.020699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:17.025620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:17.026107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:17.032130 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:17.154027 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:17.155424 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:17.165199 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:17.165993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:17.166690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:17.167718 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:17.168726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:17.169423 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:17.689617 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:17.692782 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:17.697983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-24fc9801-f15c-41a3-883f-5d45d344b976 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1267 microversion: 2.1 time: 0.549075 Sep 26 05:46:17.702444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 157/318] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:17 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1267 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:17.702718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-846911c1-0ad9-4a45-99c5-69f16054db16 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.705645 Sep 26 05:46:17.706945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 162/319] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:16 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:17.726711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:17.727322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:17.752553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:17.757314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:17.759446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:17.760460 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:17.764247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:17.765279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:18.614750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:18.624558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-354d39e6-e27f-4821-bfe3-f0c4aaf6cf93 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.920904 Sep 26 05:46:18.625217 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 158/320] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:17 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:18.742473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:18.743343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:18.750059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:18.756304 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:18.767654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:18.774057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:18.775302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:18.780184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:18.781591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:18.782434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:18.783319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:18.785746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:18.789820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:18.791625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:18.793657 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:18.797544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:19.303939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:19.311934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b7149bf6-aa45-4331-9652-5bc5d00599cf tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1273 microversion: 2.1 time: 0.572020 Sep 26 05:46:19.312648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 159/321] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:18 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1273 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:19.468647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:19.480379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-54b41c46-5937-400c-a41c-401a4c6f7b57 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.741732 Sep 26 05:46:19.481504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 163/322] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:18 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:19.664966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:19.665622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:19.672229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:19.672721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:19.673188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:19.673943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:19.674617 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:19.675054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:19.694574 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:19.966268 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:19.981787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-70be56a2-2426-4891-bc5d-02baefd32e92 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.320686 Sep 26 05:46:19.983868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 160/323] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:19 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:20.340641 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:20.342867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:20.350416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:20.350913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:20.351344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:20.352062 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:20.352510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:20.352925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:20.506461 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:20.512848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:20.513841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:20.523058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c4e50b61-514a-4a39-893b-7a9ab90e2e45 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1273 microversion: 2.1 time: 0.189506 Sep 26 05:46:20.523242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 164/324] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:20 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:20.545436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:20.545953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:20.546452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:20.547194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:20.547717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:20.548158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:20.811003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-17d2c135-1955-4ff4-a4ac-73bfc89b2174 req-2395ba32-fdcd-467a-a732-786cc1a288af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e", "name": "network-vif-plugged", "status": "completed", "tag": "78fc4bee-4c52-43f2-ac5c-5978d96703c2"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:20.841541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-17d2c135-1955-4ff4-a4ac-73bfc89b2174 req-2395ba32-fdcd-467a-a732-786cc1a288af service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:20.842877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-17d2c135-1955-4ff4-a4ac-73bfc89b2174 req-2395ba32-fdcd-467a-a732-786cc1a288af service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:20.844249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-17d2c135-1955-4ff4-a4ac-73bfc89b2174 req-2395ba32-fdcd-467a-a732-786cc1a288af service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:20.878787 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-17d2c135-1955-4ff4-a4ac-73bfc89b2174 req-2395ba32-fdcd-467a-a732-786cc1a288af service nova] Creating event network-vif-plugged:78fc4bee-4c52-43f2-ac5c-5978d96703c2 for instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e on hv-cinder-83608 Sep 26 05:46:20.888127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-17d2c135-1955-4ff4-a4ac-73bfc89b2174 req-2395ba32-fdcd-467a-a732-786cc1a288af service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086679 Sep 26 05:46:20.889045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 165/325] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:46:20.978147 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:20.991728 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d256d74a-89e1-4f0f-b608-c81a9352c7c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.487560 Sep 26 05:46:20.995780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 161/326] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:20 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:21.025157 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:21.025958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:21.038809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:21.038972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:21.039402 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:21.040108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:21.040557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:21.048241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:21.547411 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:21.548063 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:21.558071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:21.558569 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:21.558997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:21.578245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:21.578732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:21.579363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:21.681302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:21.693754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a40047df-fc74-4d31-8eb2-8b34324f962a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.673049 Sep 26 05:46:21.695111 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 166/327] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:21 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:21.990165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:22.009625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-323e6099-5030-4b4c-9d0b-64c79b9f6535 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.465611 Sep 26 05:46:22.010727 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 162/328] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:21 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:22.043535 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:22.050048 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:22.066102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:22.069094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:22.070648 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:22.071449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:22.071955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:22.072404 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:22.296069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-3a00c5f0-8add-4459-8377-9e80511b0d62 req-567c51ff-c851-46f1-a5c5-eea8f92747cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ec1360-4a0a-4b54-b1c5-f59203605511", "tag": "b69a3a3b-0e46-42b4-938e-2db6c1dcf20d"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:22.307955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-3a00c5f0-8add-4459-8377-9e80511b0d62 req-567c51ff-c851-46f1-a5c5-eea8f92747cb service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:22.308408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-3a00c5f0-8add-4459-8377-9e80511b0d62 req-567c51ff-c851-46f1-a5c5-eea8f92747cb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:22.309346 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-3a00c5f0-8add-4459-8377-9e80511b0d62 req-567c51ff-c851-46f1-a5c5-eea8f92747cb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:22.322588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-3a00c5f0-8add-4459-8377-9e80511b0d62 req-567c51ff-c851-46f1-a5c5-eea8f92747cb service nova] Creating event network-changed:b69a3a3b-0e46-42b4-938e-2db6c1dcf20d for instance e4ec1360-4a0a-4b54-b1c5-f59203605511 on hv-cinder-83608 Sep 26 05:46:22.329628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-3a00c5f0-8add-4459-8377-9e80511b0d62 req-567c51ff-c851-46f1-a5c5-eea8f92747cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036395 Sep 26 05:46:22.329628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 163/329] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:22.376029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:22.391210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d5af4983-4a8a-4c1b-b290-f1c295c45ee6 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.363580 Sep 26 05:46:22.394149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 167/330] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:22 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:22.755642 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:22.756964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:22.765314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:22.765821 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:22.766317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:22.767186 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:22.767688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:22.768131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:22.938283 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:22.951334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-381d11e7-f4eb-4e55-abdc-831a0aee85e3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.201703 Sep 26 05:46:22.961507 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 164/331] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:22 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:23.042565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:23.043227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:23.050069 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:23.050670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:23.051095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:23.051780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:23.052229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:23.052650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:23.247291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:23.259233 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-de1523dd-9aec-49cc-a0d7-9e4373b035c0 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.220949 Sep 26 05:46:23.259947 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 168/332] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:23 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:23.438173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:23.439568 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:23.453182 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:23.454239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:23.455081 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:23.456574 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:23.465838 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:23.467419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:23.671976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:23.680639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4bcbe6bd-79b4-4f4b-ab3c-e9a1b5d90d1c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1313 microversion: 2.1 time: 0.255940 Sep 26 05:46:23.681703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 165/333] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:23 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:23.976788 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:23.977561 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:23.984216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:23.984780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:23.985430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:23.986073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:23.986835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:23.987249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:24.174338 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:24.184484 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b1aac452-2135-431f-91d8-0ddbae9066b5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.211565 Sep 26 05:46:24.198223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 169/334] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:23 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:24.286639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:24.287810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:24.297324 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:24.297823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:24.298251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:24.298986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:24.300087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:24.300558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:24.479478 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:24.489066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-54af90fc-8b2d-4507-b47e-a01582f077c3 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.209650 Sep 26 05:46:24.489871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 166/335] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:24 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:24.705423 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:24.706136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:24.713592 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:24.714078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:24.714507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:24.715208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:24.715649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:24.716062 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:24.996562 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:25.008118 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f1e70737-08a8-4ebc-ad8f-92bb0ee0c128 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1498 microversion: 2.1 time: 0.306437 Sep 26 05:46:25.008791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 170/336] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:24 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1498 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:25.225473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:25.226676 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:25.241595 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:25.242602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=8 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:25.249046 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.249675 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.250185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:25.251227 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.251787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.252300 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:25.453255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:25.466287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3e39da5f-c3f1-4fab-be48-9c6fa5ad0430 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.258880 Sep 26 05:46:25.467247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 167/337] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:25 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:25.517365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:25.518246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:25.528327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.529193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.529913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:25.531115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.531860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.532564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:25.725627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:25.726484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:25.732390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.732984 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.733456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:25.734164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.734762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.735185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:25.739958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:25.749509 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d60ec6a8-943f-4d32-89e5-9844827db717 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.239276 Sep 26 05:46:25.750243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 171/338] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:25 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:25.763865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:46:25.874521 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f4567228-7787-4896-994e-6a7ca0632bf2 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 204 len: 0 microversion: 2.1 time: 0.153115 Sep 26 05:46:25.875237 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 168/339] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:46:25 2022] DELETE /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:46:25.885923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:25.886534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:25.895843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.896332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.896765 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:25.897496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:25.898180 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:25.898583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:26.214091 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:26.226219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3e88c6ca-53cd-4432-92d4-344950df55c8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1504 microversion: 2.1 time: 0.345301 Sep 26 05:46:26.226683 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 172/340] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:25 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:26.495401 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:26.496121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:26.504650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:26.505231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:26.506003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:26.507170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:26.507727 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:26.508236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:26.759667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:26.779330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e9276304-79c3-46ca-82ed-268523f3ac71 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.289909 Sep 26 05:46:26.779769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:26.780448 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:26.789747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 169/341] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:26 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:26.790190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:26.790889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:26.791807 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:26.792730 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:26.793413 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:26.794106 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:26.965414 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:26.973282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ec4c561d-2d05-4483-8eda-1cce3e3abe01 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.198317 Sep 26 05:46:26.973929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 173/342] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:26 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:27.257366 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:27.258029 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:27.265196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:27.265795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:27.266115 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:27.266826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:27.267519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:27.267942 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:27.452022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:27.460541 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3f1c0d13-3de1-49a1-9d63-9867c901dcbb tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1504 microversion: 2.1 time: 0.207702 Sep 26 05:46:27.461496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 170/343] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:27 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:27.804503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:27.805595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:27.822313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:27.822818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:27.823275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:27.823994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:27.824422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:27.824845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:28.000514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:28.002669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:28.016195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:28.017210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:28.018132 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:28.018755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:28.020463 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:28.021953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:28.023391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:28.031071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-758a769d-4e34-4482-b619-d0ae96c33247 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.229166 Sep 26 05:46:28.032093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 174/344] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:27 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:28.200645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:28.209211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-63c38e66-f0e1-4e86-ad67-cff3c9202b5b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.216141 Sep 26 05:46:28.209843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 171/345] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:27 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:28.484312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:28.484919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:28.487297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:28.494342 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:28.495020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:28.495484 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:28.496303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:28.496771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:28.497214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:28.677653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:28.690254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6acf5c26-b318-4beb-8e2a-3fe0109b3572 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1504 microversion: 2.1 time: 0.209805 Sep 26 05:46:28.691238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 175/346] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:28 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:29.060424 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:29.062796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:29.075526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:29.076796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:29.077572 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:29.079192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:29.080296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:29.081368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:29.252445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:29.253814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:29.265488 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:29.266524 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:29.267437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:29.269549 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:29.270465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:29.271305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:29.320297 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:29.330425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6b9bd77e-8ff8-4204-8a53-1788442fd345 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.277452 Sep 26 05:46:29.331080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 172/347] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:29 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:29.477349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:29.485704 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1ee34564-7f8f-4ac1-918b-1990fef46e4f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.246320 Sep 26 05:46:29.486286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 176/348] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:29 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:29.714201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:29.714894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:29.721699 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:29.722212 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:29.722775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:29.723569 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:29.723972 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:29.724484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:29.883640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:29.893107 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-de39039b-2309-4211-bd14-a95f94cf9da5 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1504 microversion: 2.1 time: 0.183205 Sep 26 05:46:29.893738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 173/349] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:29 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:30.368689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:30.369874 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:30.380713 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:30.381599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:30.382382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:30.383679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:30.384441 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:30.385238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:30.510604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:30.513941 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:30.524800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:30.526375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:30.526935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:30.527852 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:30.529162 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:30.530125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:30.588918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:30.597773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-12bcadcb-ebc8-4b2b-8248-046a7724a98f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.236184 Sep 26 05:46:30.598227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 177/350] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:30 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:30.698846 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:30.710059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-713f77d8-618e-4129-9a88-5b5bccf21413 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.204410 Sep 26 05:46:30.725687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 174/351] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:30 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:30.917511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:30.918123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:30.924460 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:30.924954 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:30.925532 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:30.926321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:30.926777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:30.927227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:31.070414 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:31.080314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-edc36d34-0413-4ea2-b0d8-1074835060c7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1504 microversion: 2.1 time: 0.166644 Sep 26 05:46:31.081273 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 178/352] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:30 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:31.629415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:31.630643 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:31.641437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:31.645884 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:31.646335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:31.647163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:31.647631 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:31.648056 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:31.733002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:31.734266 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:31.765901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:31.766576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:31.767143 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:31.769934 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:31.770525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:31.771085 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:31.776437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:31.873459 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:31.883660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4a34cdf7-f0b6-45f1-a8c9-d1824d154350 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.258275 Sep 26 05:46:31.884560 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 175/353] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:31 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:32.020541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:32.028514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-43f7ff8b-d197-41bf-95ce-425ea7ffc583 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.299455 Sep 26 05:46:32.029086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 179/354] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:31 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:32.105124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:32.105989 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:32.113663 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:32.114528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:32.115314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:32.116631 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:32.117178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:32.118443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:32.123751 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:32.192573 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:32.202153 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e7f7b543-1fa4-4840-a98e-7c889712048b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1462 microversion: 2.1 time: 0.101290 Sep 26 05:46:32.203527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 176/355] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:32 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:32.249154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-482b7b78-7927-4018-82c9-b0ab151e228e req-4d101be9-6e79-4765-b423-c2ba31c80c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e", "name": "network-vif-deleted", "tag": "78fc4bee-4c52-43f2-ac5c-5978d96703c2"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:32.268926 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-482b7b78-7927-4018-82c9-b0ab151e228e req-4d101be9-6e79-4765-b423-c2ba31c80c3d service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:32.269566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-482b7b78-7927-4018-82c9-b0ab151e228e req-4d101be9-6e79-4765-b423-c2ba31c80c3d service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:32.270227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-482b7b78-7927-4018-82c9-b0ab151e228e req-4d101be9-6e79-4765-b423-c2ba31c80c3d service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:32.284265 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-482b7b78-7927-4018-82c9-b0ab151e228e req-4d101be9-6e79-4765-b423-c2ba31c80c3d service nova] Creating event network-vif-deleted:78fc4bee-4c52-43f2-ac5c-5978d96703c2 for instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e on hv-cinder-83608 Sep 26 05:46:32.290364 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-482b7b78-7927-4018-82c9-b0ab151e228e req-4d101be9-6e79-4765-b423-c2ba31c80c3d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047931 Sep 26 05:46:32.290893 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 180/356] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:32.918444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:32.919512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:32.926753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:32.927246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:32.927677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:32.928395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:32.928848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:32.929312 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:33.053018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:33.053755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:33.061179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:33.061669 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:33.062313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:33.063222 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:33.063664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:33.064259 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:33.088476 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:33.112590 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d0d185ea-5ba5-490c-b5b2-fce41af92b83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.197770 Sep 26 05:46:33.115087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 177/357] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:32 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:33.241315 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:33.246462 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:33.247110 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:33.255826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-df1b9398-d629-44d9-bb5d-c2e1fc7294d2 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.207325 Sep 26 05:46:33.257284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 181/358] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:33 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:33.265224 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:33.267787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:33.269081 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:33.270858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:33.271953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:33.272940 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:33.422892 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:33.439866 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6fde6e39-3a37-4dc9-bce5-421f61c92eb0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1462 microversion: 2.1 time: 0.214605 Sep 26 05:46:33.442201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 178/359] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:33 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1462 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:33.476087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-fbd1dd5e-5784-48b6-b6c6-acbf167959af req-51760a82-2d84-403b-b4af-145de8625cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ec1360-4a0a-4b54-b1c5-f59203605511", "name": "network-vif-plugged", "status": "completed", "tag": "b69a3a3b-0e46-42b4-938e-2db6c1dcf20d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:33.494490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-fbd1dd5e-5784-48b6-b6c6-acbf167959af req-51760a82-2d84-403b-b4af-145de8625cb3 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:33.495546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-fbd1dd5e-5784-48b6-b6c6-acbf167959af req-51760a82-2d84-403b-b4af-145de8625cb3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:33.496235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-fbd1dd5e-5784-48b6-b6c6-acbf167959af req-51760a82-2d84-403b-b4af-145de8625cb3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:33.514373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-fbd1dd5e-5784-48b6-b6c6-acbf167959af req-51760a82-2d84-403b-b4af-145de8625cb3 service nova] Creating event network-vif-plugged:b69a3a3b-0e46-42b4-938e-2db6c1dcf20d for instance e4ec1360-4a0a-4b54-b1c5-f59203605511 on hv-cinder-83608 Sep 26 05:46:33.521693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-fbd1dd5e-5784-48b6-b6c6-acbf167959af req-51760a82-2d84-403b-b4af-145de8625cb3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053412 Sep 26 05:46:33.523318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 182/360] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:34.144424 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:34.145104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:34.152247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:34.152750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:34.153210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:34.154049 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:34.154519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:34.155124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:34.295147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:34.296241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:34.305602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:34.309950 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:34.310465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:34.310879 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:34.311761 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:34.312220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:34.312640 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:34.314847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b9be2857-958e-407c-b3d9-31929d5ecf43 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.175208 Sep 26 05:46:34.315582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 179/361] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:34 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:34.469808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:34.471304 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:34.477289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:34.482902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:34.484087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:34.485127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:34.486333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ce49bb0c-9019-4980-84cf-6f438fe2128b tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.195823 Sep 26 05:46:34.486454 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:34.487459 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:34.488181 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:34.501420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 183/362] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:34 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:34.599761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:34.608907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d1dd13f6-6cb3-4a24-aa39-9547736789fa tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1462 microversion: 2.1 time: 0.145993 Sep 26 05:46:34.609528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 180/363] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:34 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1462 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:35.340371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:35.341011 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:35.348161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:35.348652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:35.349088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:35.349831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:35.350300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:35.350719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:35.512327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:35.514933 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:35.516192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:35.524986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:35.525690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:35.526362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:35.527108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7031a123-2864-428e-a446-ee7f3bb7916e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.192323 Sep 26 05:46:35.527386 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:35.527845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 184/364] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:35 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:35.528192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:35.528615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:35.650199 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:35.651146 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:35.657563 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:35.658052 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:35.658474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:35.659201 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:35.659640 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:35.660153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:35.678859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:35.688330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-27d2781f-688f-4970-82af-f1bb8fc5b460 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.182425 Sep 26 05:46:35.693820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 181/365] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:35 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:35.719079 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:35.720135 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:35.721361 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:35.722456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lazy-loading 'fault' on Instance uuid a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:35.776842 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:35.784860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-451be657-db94-4c68-9fcf-1cc86320a786 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1303 microversion: 2.1 time: 0.138742 Sep 26 05:46:35.794058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 185/366] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:35 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:36.550299 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:36.551201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:36.558326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:36.558793 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:36.559217 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:36.559923 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:36.560363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:36.560808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:36.714563 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:36.715475 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:36.722998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:36.723789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:36.724417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:36.725263 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:36.725820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:36.726358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:36.748284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:36.773793 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5e4b0e27-dec7-4c46-9f08-c330e570a81d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.227347 Sep 26 05:46:36.774660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 182/367] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:36 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:36.808100 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:36.808707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:36.815018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:36.815505 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:36.816217 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:36.816983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:36.817489 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:36.817916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:36.857554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:36.858490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:36.858750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:36.859395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lazy-loading 'fault' on Instance uuid a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:36.891015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:36.899286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7f352566-cfce-485f-ae51-a2f013d13dc5 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1315 microversion: 2.1 time: 0.190253 Sep 26 05:46:36.899876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 186/368] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:36 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:36.907757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:36.925858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4a427223-7fd5-41e3-9384-e1856bd70332 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1303 microversion: 2.1 time: 0.120944 Sep 26 05:46:36.927105 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 183/369] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:36 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:37.797726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:37.798428 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:37.805075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:37.805588 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:37.806047 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:37.806760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:37.807211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:37.807634 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:37.923920 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:37.924491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:37.931092 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:37.931571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:37.931996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:37.932720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:37.933172 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:37.933604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:37.951606 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:37.967289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4e87eb5b-91bf-4d48-8718-ee9e341f3990 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.173508 Sep 26 05:46:37.967888 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 187/370] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:37 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:37.972393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:37.974406 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:37.986134 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:37.986886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:37.987503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:37.988395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:37.988998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:37.989595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:38.031211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:38.031704 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:38.032137 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:38.032640 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lazy-loading 'fault' on Instance uuid a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:38.081994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:38.093461 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-113c478f-67a7-46a7-9c4b-21bdef104d9a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1303 microversion: 2.1 time: 0.124514 Sep 26 05:46:38.094053 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 188/371] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:37 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:38.097445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:38.105952 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-311bf0e8-ac35-4aeb-a105-f0c99806febe tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1465 microversion: 2.1 time: 0.185853 Sep 26 05:46:38.107133 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 184/372] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:37 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1465 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:38.161516 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:38.162003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:38.168642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:38.169161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:38.169586 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:38.171534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:38.171534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:38.171534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:38.198002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:46:38.285063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-bc64d4aa-8384-4bb2-be12-e8b14839fa55 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 204 len: 0 microversion: 2.1 time: 0.127215 Sep 26 05:46:38.285777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 189/373] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:46:38 2022] DELETE /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:46:38.294063 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:38.294663 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:38.300800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:38.301413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:38.301844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:38.302535 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:38.302978 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:38.303388 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:38.439039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:38.447273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1b392354-fbf7-4762-8e65-8f8d14d5f24d tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1471 microversion: 2.1 time: 0.156966 Sep 26 05:46:38.447851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 185/374] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:38 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:38.996472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:38.997167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:39.003825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.004359 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.004791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.005534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.005987 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.006570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.117881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:39.118739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:39.126154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.126646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.127069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.128954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.129456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.129872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.146359 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:39.155230 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c656e5e4-dfbc-4d69-b3df-734e49f08903 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1500 microversion: 2.1 time: 0.162862 Sep 26 05:46:39.155741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 190/375] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:38 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1500 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:39.169578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.169578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.169743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.170080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lazy-loading 'fault' on Instance uuid a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:39.180315 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fee9c411-07db-4c4b-821e-3931d3d2ade3"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:39.183365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:39.190083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.190778 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.193794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.194827 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.195446 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.196017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.217457 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:39.225753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4de27ec7-e6fd-479f-b4c4-d6171da9b801 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1303 microversion: 2.1 time: 0.112396 Sep 26 05:46:39.226629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 186/376] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:39 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:39.249939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] HTTP exception thrown: Cannot 'attach_volume' instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc while it is in vm_state rescued Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Request method failure captured: Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: POST /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc/os-volume_attachments HTTP/1.1 Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 74 Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTwuaeuiG1qEQW0yjIPlpAPCpETHlr3RkHfKHI77C36DLeEjWyQ-XCnBZEZlkc1WqJ97pFpT_tY7DIlUs-AKhwH8GY1zD-qTM2D8gX9po477irnUEgFVnpKPjqMdxNkYYhTcRBEpUSbqPfEPbkUdDdvjbjIYTsK27n7S_vPXUyYuY3o Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:46:39.252125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c95cba08e61d4d199a3c69d99c5bc77b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 342ce12282264d40b2f2bb6f1fc6ba25 Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {"volumeAttachment": {"volumeId": "fee9c411-07db-4c4b-821e-3931d3d2ade3"}} Sep 26 05:46:39.253957 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Cannot 'attach_volume' instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc while it is in vm_state rescued Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'server_id': '69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc', 'body': {'volumeAttachment': {'volumeId': 'fee9c411-07db-4c4b-821e-3931d3d2ade3'}}} Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:46:39.258908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc while it is in vm_state rescued Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:39.260294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:39.261681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:46:39.261681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:46:39.261681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc while it is in vm_state rescued Sep 26 05:46:39.261681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:39.261681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Returning 409 to user: Cannot 'attach_volume' instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc while it is in vm_state rescued {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:46:39.261681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-259486d5-213b-4b6b-8d35-c1fd3d5885c8 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077503 Sep 26 05:46:39.261681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 191/377] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:46:39 2022] POST /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 26 05:46:39.267670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:39.268197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:39.274605 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.275085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.275518 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.276216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.276660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.277074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.350878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9a1cb7a4-ebf1-448f-afe9-ac821cb859fc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc/action" status: 202 len: 0 microversion: 2.1 time: 0.086815 Sep 26 05:46:39.351834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 187/378] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:46:39 2022] POST /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:46:39.362734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:39.363945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:39.370283 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.370775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.371206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.371958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.372373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.372790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.473464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:39.474436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:39.483559 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.484333 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.484940 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.485836 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:39.486466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:39.487037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:39.574618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:39.595439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2a722c62-b307-4102-baa4-41811e9f7501 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1508 microversion: 2.1 time: 0.237030 Sep 26 05:46:39.596013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 192/379] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:39 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:39.677034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:39.689448 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-78437aa7-8502-417b-b094-3e0d2ad9e21f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1471 microversion: 2.1 time: 0.220711 Sep 26 05:46:39.690295 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 188/380] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:39 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1471 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:40.253443 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:40.254898 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:40.264293 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:40.265296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:40.277561 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:40.278711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:40.283379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:40.283867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:40.317194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:40.317678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:40.318115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:40.318572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lazy-loading 'fault' on Instance uuid a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:40.370897 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:40.380284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7e5ad46c-2ab0-461a-b5d9-2e8d301a437c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 200 len: 1303 microversion: 2.1 time: 0.132731 Sep 26 05:46:40.381511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 193/381] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:40 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:40.632823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:40.633817 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:40.647291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:40.648150 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:40.649062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:40.650480 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:40.651368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:40.652304 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:40.720149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:40.720878 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:40.733623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:40.735040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:40.735918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:40.737350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:40.738407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:40.739501 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:41.007451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:41.014650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:41.029525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ca717986-ca82-4268-8b3a-15d5fd0e8c39 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1471 microversion: 2.1 time: 0.311089 Sep 26 05:46:41.031228 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 194/382] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:40 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:41.153518 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:41.161847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fdf31177-cc13-4806-b295-99370a6644c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1508 microversion: 2.1 time: 0.543091 Sep 26 05:46:41.162571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 189/383] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:40 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1508 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:41.391490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-1c4ffe54-feba-468b-91b5-3c1760b680d7 req-29f691a6-3e62-4294-94ac-2eeb8597eb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ec1360-4a0a-4b54-b1c5-f59203605511", "name": "network-vif-deleted", "tag": "b69a3a3b-0e46-42b4-938e-2db6c1dcf20d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:41.406159 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:41.406723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:41.412257 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1c4ffe54-feba-468b-91b5-3c1760b680d7 req-29f691a6-3e62-4294-94ac-2eeb8597eb9f service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:41.412785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1c4ffe54-feba-468b-91b5-3c1760b680d7 req-29f691a6-3e62-4294-94ac-2eeb8597eb9f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:41.413360 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1c4ffe54-feba-468b-91b5-3c1760b680d7 req-29f691a6-3e62-4294-94ac-2eeb8597eb9f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:41.414135 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:41.414652 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:41.415113 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:41.415854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:41.416525 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:41.416707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:41.436247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] HTTP exception thrown: Instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e could not be found. Sep 26 05:46:41.436556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-1c4ffe54-feba-468b-91b5-3c1760b680d7 req-29f691a6-3e62-4294-94ac-2eeb8597eb9f service nova] Creating event network-vif-deleted:b69a3a3b-0e46-42b4-938e-2db6c1dcf20d for instance e4ec1360-4a0a-4b54-b1c5-f59203605511 on hv-cinder-83608 Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Request method failure captured: Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e HTTP/1.1 Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTyZt336lvnCEE6Ooi3p_7OAOBlO-yzSFXmmrm0tHcea9KzdtDNn-EZBorbDhTFBLRqMLWGAl9dm9BaRAMTF_jZCIeO1APLK60Ggic6fLHFMjRV1M_KRE4jQ_2XXpYCf580fxdOrIwvGzKp9Jc0QoiFhaFxhGaj7Iz1I22tPVnQic9E Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: ee638507f9b0415f94f7c54e0e3db8cd Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesActionsTest-1647006259 Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:46:41.438013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee638507f9b0415f94f7c54e0e3db8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee638507f9b0415f94f7c54e0e3db8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee638507f9b0415f94f7c54e0e3db8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee638507f9b0415f94f7c54e0e3db8cd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesActionsTest-1647006259 Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: ee638507f9b0415f94f7c54e0e3db8cd Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesActionsTest-1647006259 Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesActionsTest-1647006259-project Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 04c7152003c4491abea8305c26f366ed Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesActionsTest-1647006259-project Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e could not be found. Sep 26 05:46:41.440655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e'} Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e could not be found. Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:46:41.442202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e could not be found. Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e could not be found. Sep 26 05:46:41.445348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:46:41.447335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Returning 404 to user: Instance a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:46:41.447335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-17d0f178-1497-48a7-9db0-25a6c9f35a7d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e" status: 404 len: 111 microversion: 2.1 time: 0.040328 Sep 26 05:46:41.447594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-1c4ffe54-feba-468b-91b5-3c1760b680d7 req-29f691a6-3e62-4294-94ac-2eeb8597eb9f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057197 Sep 26 05:46:41.447734 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 190/384] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:41 2022] GET /compute/v2.1/servers/a30e67b6-2f4a-48ca-a8df-3f44c90c3c6e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:46:41.447863 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 195/385] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:41.577201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1072465980", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "networks": [{"uuid": "d84453e4-a1e7-4567-8843-35b115b62bbb"}]}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:41.636503 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] validate_networks() for [('d84453e4-a1e7-4567-8843-35b115b62bbb', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:46:42.064864 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:46:42.065314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:46:42.065783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:46:42.066033 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:42.066187 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:46:42.067237 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:46:42.067390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:42.075198 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:42.075961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:42.076624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:42.076840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:42.077362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:42.077582 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:42.077788 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:42.078190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:42.078680 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:42.078829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:42.079449 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:42.079875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:42.121371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Getting quotas for project ee638507f9b0415f94f7c54e0e3db8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:46:42.121371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Getting quotas for user 04c7152003c4491abea8305c26f366ed and project ee638507f9b0415f94f7c54e0e3db8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:46:42.131667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:46:42.134903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:46:42.143741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:42.145738 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:42.146702 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:42.148332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lazy-loading 'fault' on Instance uuid e4ec1360-4a0a-4b54-b1c5-f59203605511 {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:42.196891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7d6883f7-3ec8-4017-974a-23e26b0a8887 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623871 Sep 26 05:46:42.198236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 191/386] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:46:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:46:42.203529 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:42.205011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:42.214302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:42.216331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:42.219861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:42.220481 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:42.221406 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:42.223935 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c5357278-d7d7-44a9-ab5a-407ef55fa892 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1305 microversion: 2.1 time: 0.162206 Sep 26 05:46:42.224811 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:42.225468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:42.225772 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 196/387] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:42 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1305 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:42.251174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-90335ae9-880b-4183-8d45-250fcd5c23b1 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:42.251803 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-90335ae9-880b-4183-8d45-250fcd5c23b1 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:42.270835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:42.344911 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-90335ae9-880b-4183-8d45-250fcd5c23b1 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:42.358007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-90335ae9-880b-4183-8d45-250fcd5c23b1 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1214 microversion: 2.1 time: 0.130664 Sep 26 05:46:42.359483 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 197/388] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:42 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:42.456897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:42.466946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6ff2fc84-48e9-4d77-ad36-501b81639423 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1508 microversion: 2.1 time: 0.267231 Sep 26 05:46:42.467785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 192/389] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:42 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:43.264209 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:43.264838 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:43.271318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:43.271805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:43.272235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:43.272935 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:43.273418 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:43.273837 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:43.307478 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:43.307958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:43.308390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:43.308831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lazy-loading 'fault' on Instance uuid e4ec1360-4a0a-4b54-b1c5-f59203605511 {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:43.353930 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:43.362158 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f54cfaa7-323e-49a4-9bd2-1f5b5a0c9f89 tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1305 microversion: 2.1 time: 0.101975 Sep 26 05:46:43.362739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 198/390] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:43 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:43.389808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:43.390428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:43.397709 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:43.398124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:43.398619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:43.399278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:43.399737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:43.400157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:43.469287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:43.479914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a4f52fbd-dad2-49dd-a464-2ef9e7b705f3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1218 microversion: 2.1 time: 0.093990 Sep 26 05:46:43.480496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 193/391] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:43 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:43.492689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:43.493415 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:43.499531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:43.500011 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:43.500435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:43.501128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:43.501598 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:43.502012 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:43.652625 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:43.661043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3bc2d354-89a6-4abb-aed2-354b29915b0a tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1508 microversion: 2.1 time: 0.172243 Sep 26 05:46:43.661672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 199/392] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:43 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:44.387031 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:44.387623 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:44.389551 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:44.396537 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:44.397229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:44.397497 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:44.398198 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:44.398648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:44.399067 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:44.434038 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:44.434513 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:44.434963 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:44.435384 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lazy-loading 'fault' on Instance uuid e4ec1360-4a0a-4b54-b1c5-f59203605511 {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:46:44.478741 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97028c1b3fe141dea0fa530a4b8aff30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c05c9127854481aa2ff754f336e7895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:44.486814 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2de0ddf4-dad6-4ae9-b4e4-da04fc3ce22f tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 200 len: 1305 microversion: 2.1 time: 0.103602 Sep 26 05:46:44.487668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 194/393] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:44 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:44.503040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:44.503643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:44.509715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:44.510195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:44.510624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:44.511309 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:44.511758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:44.512204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:44.573612 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:44.584620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b815b08e-b4f7-4b79-a308-a22a5161ba5e tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1210 microversion: 2.1 time: 0.085094 Sep 26 05:46:44.585700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 200/394] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:44 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:44.687365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:44.688237 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:44.699264 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:44.700078 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:44.700765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:44.701903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:44.702650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:44.713584 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:44.906158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:44.914093 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ff5c3612-9a06-4fa2-9934-eda5896be047 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1508 microversion: 2.1 time: 0.232895 Sep 26 05:46:44.914660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 195/395] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:44 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:45.510502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:45.511109 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] [instance: e4ec1360-4a0a-4b54-b1c5-f59203605511] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:45.517543 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:45.518033 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:45.518468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:45.519173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:45.519642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:45.520040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:45.537763 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] HTTP exception thrown: Instance e4ec1360-4a0a-4b54-b1c5-f59203605511 could not be found. Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Request method failure captured: Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 HTTP/1.1 Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTyiJ29i3UT7xVijs0Vdy_KYO45IHPH5Loy4KK4yQ4Fv74jJ-DWGk8RouJlSEp2eR_cNpqFDnDL9Gx_4RToco5G4iWz7o7NO0WpwsX-Tcpog0hdE4FABSurbkh-zVvypjg7-Nd7RKzRrwuoKFoen3lAXS6By3xurJPtIkDqawgeUsOs Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 9c05c9127854481aa2ff754f336e7895 Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-VolumesNegativeTest-466332707 Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:46:45.539551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9c05c9127854481aa2ff754f336e7895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9c05c9127854481aa2ff754f336e7895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9c05c9127854481aa2ff754f336e7895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9c05c9127854481aa2ff754f336e7895", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-VolumesNegativeTest-466332707 Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 9c05c9127854481aa2ff754f336e7895 Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-VolumesNegativeTest-466332707 Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-VolumesNegativeTest-466332707-project Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 97028c1b3fe141dea0fa530a4b8aff30 Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-VolumesNegativeTest-466332707-project Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance e4ec1360-4a0a-4b54-b1c5-f59203605511 could not be found. Sep 26 05:46:45.541886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': 'e4ec1360-4a0a-4b54-b1c5-f59203605511'} Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ec1360-4a0a-4b54-b1c5-f59203605511 could not be found. Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:46:45.543306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ec1360-4a0a-4b54-b1c5-f59203605511 could not be found. Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ec1360-4a0a-4b54-b1c5-f59203605511 could not be found. Sep 26 05:46:45.545632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:46:45.547290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] Returning 404 to user: Instance e4ec1360-4a0a-4b54-b1c5-f59203605511 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:46:45.547290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-af15c85c-a433-46cb-a627-ecccc1f2ca4c tempest-VolumesNegativeTest-466332707 tempest-VolumesNegativeTest-466332707-project] 10.222.0.57 "GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511" status: 404 len: 111 microversion: 2.1 time: 0.035108 Sep 26 05:46:45.547290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 201/396] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:45 2022] GET /compute/v2.1/servers/e4ec1360-4a0a-4b54-b1c5-f59203605511 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:46:45.609756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:45.610829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:45.619453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:45.620607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:45.621340 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:45.622467 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:45.623207 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:45.623780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:45.721254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:45.731578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-11339a2d-9c84-401b-a44f-df821937c24c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1266 microversion: 2.1 time: 0.126401 Sep 26 05:46:45.732471 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 196/397] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:45 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:45.940007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:45.940696 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:45.951392 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:45.952100 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:45.952776 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:45.953748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:45.954381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:45.954977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:46.124965 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:46.133385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5faf6132-1685-4ebd-952f-d92374b98d40 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1514 microversion: 2.1 time: 0.197151 Sep 26 05:46:46.133955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 202/398] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:45 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:46.759083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:46.760355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:46.768901 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:46.769904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:46.770620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:46.771973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:46.772664 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:46.773322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:47.104067 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:47.112197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5da3aa5a-96d9-4df0-959d-e1a3bd1d9671 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.360400 Sep 26 05:46:47.113052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 197/399] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:46 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:47.763546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-271d860a-a592-4403-ae55-552ef0ac655c req-87c7790b-cd68-4052-a834-679c6b1e0386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3221a5e-1e82-457f-ade2-238d0f4443cb", "tag": "2b0362b1-99df-49d2-a146-a858eb58337d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:47.785482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-271d860a-a592-4403-ae55-552ef0ac655c req-87c7790b-cd68-4052-a834-679c6b1e0386 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:47.786550 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-271d860a-a592-4403-ae55-552ef0ac655c req-87c7790b-cd68-4052-a834-679c6b1e0386 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:47.787465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-271d860a-a592-4403-ae55-552ef0ac655c req-87c7790b-cd68-4052-a834-679c6b1e0386 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:47.809662 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-271d860a-a592-4403-ae55-552ef0ac655c req-87c7790b-cd68-4052-a834-679c6b1e0386 service nova] Creating event network-changed:2b0362b1-99df-49d2-a146-a858eb58337d for instance c3221a5e-1e82-457f-ade2-238d0f4443cb on hv-cinder-83608 Sep 26 05:46:47.820194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-271d860a-a592-4403-ae55-552ef0ac655c req-87c7790b-cd68-4052-a834-679c6b1e0386 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062402 Sep 26 05:46:47.821783 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 203/400] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:48.141654 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:48.143180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:48.153819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:48.155756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:48.156478 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:48.157552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:48.158420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:48.159028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:48.426712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:48.444215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d607dc1d-00ad-44af-aef0-e7755e45c852 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.308577 Sep 26 05:46:48.457614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 198/401] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:48 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:48.723680 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-28aad5f7-3692-4e1a-9668-75170ea16b7e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'create', calling method: .version_select at 0x7f1e5e799310>, body: {"keypair": {"name": "tempest-keypair-951590994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2gd0C23jMTTHN0e6Y5zn121+N0Yt3zh51Krf3V9bxQov6gLT0+X5lpH03Pi6uj0vQ4c3i7iG76RzMkCHoT3ySqZFjbnU/rFfoOVVZSFHeoE3ldUilIMI1T44hhwaiOxA=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:48.751948 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-28aad5f7-3692-4e1a-9668-75170ea16b7e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:46:48.760009 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-28aad5f7-3692-4e1a-9668-75170ea16b7e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for user 342ce12282264d40b2f2bb6f1fc6ba25 and project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:46:48.796069 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-28aad5f7-3692-4e1a-9668-75170ea16b7e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080700 Sep 26 05:46:48.796945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 204/402] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:46:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:49.476793 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:49.478210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:49.497354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:49.497947 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:49.498574 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:49.499573 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:49.500252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:49.500817 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:49.777102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:49.803046 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2d2936d8-93b3-4983-8f68-297005a005e4 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.324678 Sep 26 05:46:49.809251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 199/403] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:49 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:50.691586 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-678884066", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdedc4e6-9308-457c-af01-ae4f7a8e4d99"}], "security_groups": [{"name": "tempest-securitygroup--1407182425"}], "key_name": "tempest-keypair-951590994", "user_data": "}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:50.829735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:50.839793 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:50.856632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:50.857169 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:50.857960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:50.858750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:50.859241 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:50.859678 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:50.864956 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] validate_networks() for [('bdedc4e6-9308-457c-af01-ae4f7a8e4d99', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:46:51.075670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:51.096334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7f632dcc-3f4a-4711-91d2-93872f046bb8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.272534 Sep 26 05:46:51.097979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 200/404] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:50 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:51.508885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:46:51.509346 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:46:51.509992 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:46:51.510401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:46:51.510812 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:46:51.534177 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:51.534672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:51.535329 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:51.536768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:51.537324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:51.537985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:51.561091 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:46:51.568086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Getting quotas for user 342ce12282264d40b2f2bb6f1fc6ba25 and project c95cba08e61d4d199a3c69d99c5bc77b. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:46:51.582959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:51.590887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:46:51.593808 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:46:51.651635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-069a1225-0f61-4074-ba5c-fd11ec17ffcc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.964922 Sep 26 05:46:51.652978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 205/405] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:46:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:46:51.668165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5b424342-08cf-43fb-9324-8cc15bfee7cc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:51.669543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5b424342-08cf-43fb-9324-8cc15bfee7cc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:51.814990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5b424342-08cf-43fb-9324-8cc15bfee7cc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:51.826813 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5b424342-08cf-43fb-9324-8cc15bfee7cc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1244 microversion: 2.1 time: 0.163981 Sep 26 05:46:51.827923 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 201/406] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:51 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1244 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:52.140316 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:52.141903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:52.154412 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:52.156482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:52.157337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:52.158692 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:52.159560 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:52.160595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:52.739161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:52.752949 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f6f8bb3a-314b-4429-8a06-fffefaa3a113 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.619451 Sep 26 05:46:52.753851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 206/407] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:52 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:52.858733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:52.859880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:52.865004 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:52.878463 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:52.879602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:52.880407 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:52.881625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:52.882459 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:52.882973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:53.000217 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:53.009966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4ceba779-387b-43e0-bc8c-4c4a913bb99c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1296 microversion: 2.1 time: 0.159352 Sep 26 05:46:53.010718 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 202/408] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:52 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:53.790789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:53.793687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:53.802865 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:53.804055 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:53.804817 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:53.806005 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:53.806707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:53.807229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:54.050698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:54.064938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:54.067562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:54.085912 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-10de8b2a-d761-493c-96c0-d17f3f2fb345 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.298372 Sep 26 05:46:54.089604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:54.090491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:54.091278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:54.092602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:54.101609 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:54.102446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:54.109569 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 207/409] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:53 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:54.559461 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:54.574064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-49e46411-d6c3-46d3-94c1-dc1d7b0969e7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1302 microversion: 2.1 time: 0.533216 Sep 26 05:46:54.575308 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 203/410] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:54 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1302 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:55.130676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:55.131536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:55.139359 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:55.139857 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:55.140280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:55.140980 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:55.141625 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:55.142243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:55.339225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:55.359602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3a145ed7-af48-465c-b68e-652b2bb8348b tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.232948 Sep 26 05:46:55.369224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 208/411] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:55 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:46:55.609449 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:55.612982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:55.629404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:55.633381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:55.635158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:55.637008 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:55.638458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:55.639437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:55.982469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:56.000505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-1976f8aa-5b2f-42f9-993f-0e2c094b7843 req-da9499fd-bb6d-4bcd-9499-e3d8a72cb578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3221a5e-1e82-457f-ade2-238d0f4443cb", "name": "network-vif-plugged", "status": "completed", "tag": "2b0362b1-99df-49d2-a146-a858eb58337d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:56.015753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1976f8aa-5b2f-42f9-993f-0e2c094b7843 req-da9499fd-bb6d-4bcd-9499-e3d8a72cb578 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:56.016558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1976f8aa-5b2f-42f9-993f-0e2c094b7843 req-da9499fd-bb6d-4bcd-9499-e3d8a72cb578 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:56.017392 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1976f8aa-5b2f-42f9-993f-0e2c094b7843 req-da9499fd-bb6d-4bcd-9499-e3d8a72cb578 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:56.023943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d2c0b53e-18a7-495a-87fa-5c14c40b7257 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.417979 Sep 26 05:46:56.035161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-1976f8aa-5b2f-42f9-993f-0e2c094b7843 req-da9499fd-bb6d-4bcd-9499-e3d8a72cb578 service nova] Creating event network-vif-plugged:2b0362b1-99df-49d2-a146-a858eb58337d for instance c3221a5e-1e82-457f-ade2-238d0f4443cb on hv-cinder-83608 Sep 26 05:46:56.045881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-1976f8aa-5b2f-42f9-993f-0e2c094b7843 req-da9499fd-bb6d-4bcd-9499-e3d8a72cb578 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049343 Sep 26 05:46:56.046643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 209/412] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:46:56.059083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 204/413] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:55 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:56.406443 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:56.408773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:56.424728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:56.426271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:56.427598 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:56.430127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:56.431306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:56.433890 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:56.665949 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:56.678172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2b43a419-ecb8-42b2-8d11-d1e4954e4ce3 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.281201 Sep 26 05:46:56.678493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-225082e7-a965-436a-8854-3407c8973855 req-fabd0ade-9882-4dae-b773-a90870063456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09331c3-4186-46a6-abeb-f3e5ef0ec10d", "tag": "438d048d-b815-4fa3-98df-918b47d1b86c"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:46:56.680472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 210/414] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:56 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:56.705945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-225082e7-a965-436a-8854-3407c8973855 req-fabd0ade-9882-4dae-b773-a90870063456 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:56.706888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-225082e7-a965-436a-8854-3407c8973855 req-fabd0ade-9882-4dae-b773-a90870063456 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:56.707750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-225082e7-a965-436a-8854-3407c8973855 req-fabd0ade-9882-4dae-b773-a90870063456 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:56.730730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-225082e7-a965-436a-8854-3407c8973855 req-fabd0ade-9882-4dae-b773-a90870063456 service nova] Creating event network-changed:438d048d-b815-4fa3-98df-918b47d1b86c for instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d on hv-cinder-83608 Sep 26 05:46:56.740302 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-225082e7-a965-436a-8854-3407c8973855 req-fabd0ade-9882-4dae-b773-a90870063456 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068697 Sep 26 05:46:56.741899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 205/415] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:46:57.074393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:57.075071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:57.082264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:57.083093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:57.083633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:57.084706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:57.085450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:57.086548 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:57.294111 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:57.303710 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cd514098-a659-4fdd-ae28-6719e452a2d2 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.233180 Sep 26 05:46:57.304308 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 211/416] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:57 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:57.726121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:57.727254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:57.736224 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:57.736722 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:57.737180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:57.737910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:57.738383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:57.738787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:58.169210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:58.185812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4aabf4ca-6a68-4d84-92f3-5a8c7aed4929 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1314 microversion: 2.1 time: 0.466377 Sep 26 05:46:58.186797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 206/417] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:57 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:58.327767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:58.328728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:58.336993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:58.337776 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:58.338295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:58.339030 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:58.339497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:58.339919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:58.548999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:58.559208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-943d593e-0fa6-4f25-afeb-9b769226baf3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.235238 Sep 26 05:46:58.560037 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 212/418] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:58 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:59.214489 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:59.215519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:59.224618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:59.225399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:59.225993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:59.226936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:59.227529 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:59.228001 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:59.446764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:59.455734 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6e15d696-ee7f-46c2-b867-24f458bbbd3c tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1499 microversion: 2.1 time: 0.246809 Sep 26 05:46:59.456307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 207/419] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:59 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1499 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:46:59.585438 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:46:59.587125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:46:59.595850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:59.596521 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:59.597261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:59.598399 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:46:59.599137 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:46:59.599990 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:46:59.818116 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:46:59.826596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-dd7f2116-3512-4b38-be6f-dbbfab52d31d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.246479 Sep 26 05:46:59.827203 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 213/420] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:46:59 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:00.147415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:00.147958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:00.154485 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:00.154966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:00.155394 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:00.156109 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:00.156565 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:00.156981 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:00.184917 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:47:00.257030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:00.301824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-beb9d5a6-8b81-44c4-ba71-ddc96240b48d tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 204 len: 0 microversion: 2.1 time: 0.158043 Sep 26 05:47:00.302467 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 208/421] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:47:00 2022] DELETE /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:47:00.311693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:00.312316 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:00.319619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:00.320101 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:00.320525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:00.321280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:00.321736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:00.322148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:00.511832 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:00.521464 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8c02c9a7-6166-4645-a458-d5e7a50664b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1505 microversion: 2.1 time: 0.213886 Sep 26 05:47:00.522181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 214/422] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:00 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:47:00.863866 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:00.864611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:00.873977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:00.874609 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:00.875281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:00.876523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:00.876998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:00.877707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:01.048982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:01.058243 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-444d4547-fc27-42b6-8962-ee7394ef3c85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.198776 Sep 26 05:47:01.058934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 209/423] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:00 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:01.548364 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:01.549428 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:01.551905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:01.558848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:01.559433 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:01.560025 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:01.560825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:01.561387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:01.561972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:01.580036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=12 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:01.740153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:01.751909 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-68e3699c-a481-4829-a47d-668e370038f7 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1505 microversion: 2.1 time: 0.208032 Sep 26 05:47:01.753073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 215/424] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:01 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:47:02.086431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:02.087426 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:02.091724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=8 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:02.101633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:02.102444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:02.103214 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:02.104499 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:02.105404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:02.106165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:02.297986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:02.312840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d6f998f4-49b9-4456-8deb-62f9298eedaa tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.233862 Sep 26 05:47:02.313880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 210/425] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:02 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:02.794434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:02.795496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:02.807701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:02.808329 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:02.808864 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:02.810770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:02.811000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:02.811558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:02.815726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:02.972241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:02.984083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-36b30a9d-74e8-4313-a5ca-e4cc564217b0 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1505 microversion: 2.1 time: 0.198490 Sep 26 05:47:02.984669 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 216/426] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:02 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:03.339428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:03.340056 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:03.347471 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:03.347985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:03.348422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:03.349170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:03.349783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:03.350220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:03.548880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:03.568208 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7e9bca97-e9e4-4c16-9e6b-aca97985a5ca tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.232975 Sep 26 05:47:03.569239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 211/427] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:03 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:04.008235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:04.008812 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:04.015643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:04.016142 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:04.016684 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:04.017585 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:04.018107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:04.018516 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:04.199065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:04.207397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-27f06a2b-54bd-4044-800d-a88e1203db30 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1505 microversion: 2.1 time: 0.203336 Sep 26 05:47:04.207987 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 217/428] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:04 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:04.609603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:04.610730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:04.622219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:04.622934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:04.623488 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:04.625086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:04.625728 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:04.626260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:04.818797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:04.829114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e3a64290-0fda-457f-b5d6-2f8c4110ed1b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.224896 Sep 26 05:47:04.829747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 212/429] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:04 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:47:05.231587 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:05.232374 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:05.241809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:05.242312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:05.242732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:05.243467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:05.243930 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:05.244340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:05.415431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:05.435967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f091c824-f158-4107-a5ac-3bde7121a627 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1505 microversion: 2.1 time: 0.207892 Sep 26 05:47:05.439973 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 218/430] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:05 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:05.857261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:05.858118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:05.865559 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:05.866115 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:05.866581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:05.867493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:05.868134 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:05.868670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:06.036297 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:06.045437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1ef882fc-2402-4030-a4a3-6d07637339dc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.192205 Sep 26 05:47:06.046033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 213/431] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:05 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:06.401387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-5bc1b5c7-afdd-4989-8ea3-ef69a76efdec req-ac8f01b8-a634-4802-8e49-5559e494e4ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09331c3-4186-46a6-abeb-f3e5ef0ec10d", "name": "network-vif-plugged", "status": "completed", "tag": "438d048d-b815-4fa3-98df-918b47d1b86c"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:47:06.430839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-5bc1b5c7-afdd-4989-8ea3-ef69a76efdec req-ac8f01b8-a634-4802-8e49-5559e494e4ac service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:06.431771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-5bc1b5c7-afdd-4989-8ea3-ef69a76efdec req-ac8f01b8-a634-4802-8e49-5559e494e4ac service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:06.432581 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-5bc1b5c7-afdd-4989-8ea3-ef69a76efdec req-ac8f01b8-a634-4802-8e49-5559e494e4ac service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:06.468934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:06.470083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:06.474827 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-5bc1b5c7-afdd-4989-8ea3-ef69a76efdec req-ac8f01b8-a634-4802-8e49-5559e494e4ac service nova] Creating event network-vif-plugged:438d048d-b815-4fa3-98df-918b47d1b86c for instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d on hv-cinder-83608 Sep 26 05:47:06.478134 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:06.478726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:06.479387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:06.480355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:06.481069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:06.481727 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:06.487517 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-5bc1b5c7-afdd-4989-8ea3-ef69a76efdec req-ac8f01b8-a634-4802-8e49-5559e494e4ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105639 Sep 26 05:47:06.489016 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 219/432] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:47:06.721621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:06.736482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2d95d419-a99f-41c3-ae40-a8e81983fca8 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1505 microversion: 2.1 time: 0.277165 Sep 26 05:47:06.737658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 214/433] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:06 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:06.848097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-c25fb403-7889-4735-ada7-bdc2421dbafa req-d00f652f-5bce-4013-9b57-2453635b51d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3221a5e-1e82-457f-ade2-238d0f4443cb", "name": "network-vif-deleted", "tag": "2b0362b1-99df-49d2-a146-a858eb58337d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:47:06.864167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-c25fb403-7889-4735-ada7-bdc2421dbafa req-d00f652f-5bce-4013-9b57-2453635b51d5 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:06.864752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-c25fb403-7889-4735-ada7-bdc2421dbafa req-d00f652f-5bce-4013-9b57-2453635b51d5 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:06.865564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-c25fb403-7889-4735-ada7-bdc2421dbafa req-d00f652f-5bce-4013-9b57-2453635b51d5 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:06.882494 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-c25fb403-7889-4735-ada7-bdc2421dbafa req-d00f652f-5bce-4013-9b57-2453635b51d5 service nova] Creating event network-vif-deleted:2b0362b1-99df-49d2-a146-a858eb58337d for instance c3221a5e-1e82-457f-ade2-238d0f4443cb on hv-cinder-83608 Sep 26 05:47:06.892925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-c25fb403-7889-4735-ada7-bdc2421dbafa req-d00f652f-5bce-4013-9b57-2453635b51d5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060200 Sep 26 05:47:06.893590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 220/434] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:47:07.084613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:07.085495 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:07.093396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:07.094066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:07.094730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:07.095635 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:07.096468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:07.097207 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:07.246997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:07.257871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c4ac3a23-472d-41ed-a839-d1deffbd0ac7 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.176606 Sep 26 05:47:07.258946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 215/435] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:07 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:07.773000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:07.773730 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:07.781334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:07.781861 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:07.782297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:07.783017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:07.783477 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:07.783903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:07.820277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:07.820920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:07.821494 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:07.822147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lazy-loading 'fault' on Instance uuid c3221a5e-1e82-457f-ade2-238d0f4443cb {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:47:07.870885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:07.879464 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-eee79c77-2529-4380-bb2c-eb4f7c23f76a tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1304 microversion: 2.1 time: 0.110774 Sep 26 05:47:07.880061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 221/436] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:07 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:08.282974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:08.283911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:08.291044 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:08.291513 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:08.291970 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:08.292672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:08.293167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:08.293693 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:08.463246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:08.472035 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a25ab123-aa77-47f8-b025-24f34ca7c279 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1370 microversion: 2.1 time: 0.192928 Sep 26 05:47:08.472554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 216/437] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:08 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:08.904349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:08.905453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:08.913486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:08.914070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:08.914504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:08.915361 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:08.915925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:08.916522 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:08.953871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:08.954233 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:08.954693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:08.955143 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lazy-loading 'fault' on Instance uuid c3221a5e-1e82-457f-ade2-238d0f4443cb {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:47:09.001328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c7152003c4491abea8305c26f366ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee638507f9b0415f94f7c54e0e3db8cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:09.011347 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-89667245-7851-467d-ab28-17866a9c2675 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 200 len: 1304 microversion: 2.1 time: 0.110926 Sep 26 05:47:09.012055 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 222/438] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:08 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:09.495894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:09.496608 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:09.503870 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:09.504365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:09.504769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:09.505533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:09.506070 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:09.506524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:09.664517 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:47:09.673158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-52c7c256-2c95-4ed3-b85e-6712c57da883 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1563 microversion: 2.1 time: 0.181352 Sep 26 05:47:09.673764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 217/439] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:09 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:47:09.696848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:09.697372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:09.704182 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:09.704681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:09.705116 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:09.705966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:09.706334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:09.706736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:09.796036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2a77a92b-ceb6-40e1-ac25-78cea32fb4d5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103286 Sep 26 05:47:09.796826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 223/440] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:47:09 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:47:10.052091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:47:10.053315 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] [instance: c3221a5e-1e82-457f-ade2-238d0f4443cb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:47:10.071865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:10.073040 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:10.073880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:10.078483 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:10.080647 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:10.081552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:10.116461 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] HTTP exception thrown: Instance c3221a5e-1e82-457f-ade2-238d0f4443cb could not be found. Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Request method failure captured: Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb HTTP/1.1 Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTyZt336lvnCEE6Ooi3p_7OAOBlO-yzSFXmmrm0tHcea9KzdtDNn-EZBorbDhTFBLRqMLWGAl9dm9BaRAMTF_jZCIeO1APLK60Ggic6fLHFMjRV1M_KRE4jQ_2XXpYCf580fxdOrIwvGzKp9Jc0QoiFhaFxhGaj7Iz1I22tPVnQic9E Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: ee638507f9b0415f94f7c54e0e3db8cd Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesActionsTest-1647006259 Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:47:10.121948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee638507f9b0415f94f7c54e0e3db8cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ee638507f9b0415f94f7c54e0e3db8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ee638507f9b0415f94f7c54e0e3db8cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ee638507f9b0415f94f7c54e0e3db8cd", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesActionsTest-1647006259 Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: ee638507f9b0415f94f7c54e0e3db8cd Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesActionsTest-1647006259 Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesActionsTest-1647006259-project Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 04c7152003c4491abea8305c26f366ed Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesActionsTest-1647006259-project Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance c3221a5e-1e82-457f-ade2-238d0f4443cb could not be found. Sep 26 05:47:10.123570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'c3221a5e-1e82-457f-ade2-238d0f4443cb'} Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3221a5e-1e82-457f-ade2-238d0f4443cb could not be found. Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:47:10.124458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3221a5e-1e82-457f-ade2-238d0f4443cb could not be found. Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3221a5e-1e82-457f-ade2-238d0f4443cb could not be found. Sep 26 05:47:10.126009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:47:10.127293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] Returning 404 to user: Instance c3221a5e-1e82-457f-ade2-238d0f4443cb could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:47:10.127293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ffcccd91-6008-4989-9114-870255512531 tempest-VolumesActionsTest-1647006259 tempest-VolumesActionsTest-1647006259-project] 10.222.0.57 "GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb" status: 404 len: 111 microversion: 2.1 time: 0.090131 Sep 26 05:47:10.134735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 218/441] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:47:10 2022] GET /compute/v2.1/servers/c3221a5e-1e82-457f-ade2-238d0f4443cb => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:47:11.124170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-81e63310-7316-4339-b063-8bccb05267ef req-9fa288c3-6ecd-4def-82a0-f6fb8fc926fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09331c3-4186-46a6-abeb-f3e5ef0ec10d", "tag": "438d048d-b815-4fa3-98df-918b47d1b86c"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:47:11.135616 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-81e63310-7316-4339-b063-8bccb05267ef req-9fa288c3-6ecd-4def-82a0-f6fb8fc926fe service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:47:11.136343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-81e63310-7316-4339-b063-8bccb05267ef req-9fa288c3-6ecd-4def-82a0-f6fb8fc926fe service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:47:11.136767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-81e63310-7316-4339-b063-8bccb05267ef req-9fa288c3-6ecd-4def-82a0-f6fb8fc926fe service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:47:11.150366 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-81e63310-7316-4339-b063-8bccb05267ef req-9fa288c3-6ecd-4def-82a0-f6fb8fc926fe service nova] Creating event network-changed:438d048d-b815-4fa3-98df-918b47d1b86c for instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d on hv-cinder-83608 Sep 26 05:47:11.156239 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-81e63310-7316-4339-b063-8bccb05267ef req-9fa288c3-6ecd-4def-82a0-f6fb8fc926fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035861 Sep 26 05:47:11.158132 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 224/442] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:48:09.665958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:09.668358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:09.680458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:09.682569 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=56 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:09.686085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 05:48:09.686784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 05:48:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/ips (ip 10.222.0.57) !!! Sep 26 05:48:09.690003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:09.690575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:09.691076 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:09.691870 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:09.692955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:09.694013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:09.734761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fa26640d-fa81-4c79-b76b-9048e754dd9e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/ips" status: 200 len: 146 microversion: 2.1 time: 0.076001 Sep 26 05:48:09.735327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 219/443] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:48:09 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:48:11.110445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5da8813a-252d-405f-959f-c58e350af227 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Action: 'create', calling method: .version_select at 0x7f1e5f2d18b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1326552618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwlH9sVOBpn4E4gWh1lixZAHUPEFbR5NSIGUqU+v0w/oHFSREIYhiiSPjyGoSgW7zoTRrfE1zXfZc/zzD97dXVj3x7Xq2Bdcq42zgglMJyHwSmVZRSA5je4PRzC/1pjHg=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:11.117102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:11.117770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=43 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:11.132302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-5da8813a-252d-405f-959f-c58e350af227 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Getting quotas for project 0b095f1ee00e46cfabebc2dc34992997. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:48:11.136260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-5da8813a-252d-405f-959f-c58e350af227 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Getting quotas for user 3cab2568112f46bca576f17916887aa7 and project 0b095f1ee00e46cfabebc2dc34992997. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:48:11.163579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5da8813a-252d-405f-959f-c58e350af227 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057373 Sep 26 05:48:11.164161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 225/444] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:48:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:48:11.302330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1205871594", "imageRef": "3ec84d33-030a-4439-b9a3-621185059f37", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1326552618", "networks": [{"uuid": "771f5ef7-1d1c-4a89-a6da-69974fc9fb9f"}]}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:11.373612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] validate_networks() for [('771f5ef7-1d1c-4a89-a6da-69974fc9fb9f', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:48:11.780823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:48:11.781277 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:48:11.781752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:48:11.782157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:48:11.782567 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:48:11.791770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:11.792258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:11.792740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:11.793487 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:11.793962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:11.794367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:11.811654 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Getting quotas for project 0b095f1ee00e46cfabebc2dc34992997. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:48:11.815929 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Getting quotas for user 3cab2568112f46bca576f17916887aa7 and project 0b095f1ee00e46cfabebc2dc34992997. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:48:11.827751 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:48:11.830019 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ec84d33-030a-4439-b9a3-621185059f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:48:11.881381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9ce69f7e-0dc0-4e1d-beca-9c84940ed129 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582886 Sep 26 05:48:11.882402 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 220/445] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:48:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 05:48:11.893559 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-be5c053b-024b-45af-9bd2-39232a97dc96 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:11.894381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-be5c053b-024b-45af-9bd2-39232a97dc96 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:11.953798 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-be5c053b-024b-45af-9bd2-39232a97dc96 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:11.963121 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-be5c053b-024b-45af-9bd2-39232a97dc96 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1259 microversion: 2.1 time: 0.073536 Sep 26 05:48:11.963721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 226/446] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:11 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:12.987089 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:12.987698 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:12.994577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:12.995086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:12.995520 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:12.996236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:12.996687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:12.997107 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:13.068069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:13.076819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6125c997-eebb-4626-907b-9a6890697fd6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1311 microversion: 2.1 time: 0.094256 Sep 26 05:48:13.077453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 221/447] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:12 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:13.205073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2f925ed-c2de-4af5-8935-26d419e74567"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:13.208656 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:13.215950 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:13.216522 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:13.216955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:13.217677 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:13.218300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:13.218875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:13.713208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-49a369de-8995-4076-a843-ea043a324f99 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511704 Sep 26 05:48:13.714527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 227/448] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:48:13 2022] POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:48:14.100604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:14.101482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:14.108613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:14.109353 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:14.110506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:14.115666 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:14.116982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:14.117595 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:14.410776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:14.424878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-80dfcdc9-ee9a-40a5-af3a-f484b2aed863 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.327935 Sep 26 05:48:14.426867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 222/449] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:14 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:15.456446 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:15.457852 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:15.466916 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:15.467743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:15.468338 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:15.469330 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:15.469969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:15.470393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:15.627787 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:15.636092 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8512b827-1133-4a4d-acbf-a69c3a16f4a0 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.183949 Sep 26 05:48:15.637328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 228/450] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:15 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:16.660137 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:16.660764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:16.667211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:16.667776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:16.668196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:16.668921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:16.669406 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:16.669828 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:16.903858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:16.912789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-062566b5-4844-44fa-a603-c36a40777a91 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.256666 Sep 26 05:48:16.913428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 223/451] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:16 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:17.951614 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:17.951614 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:17.956767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:17.958501 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:17.960174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:17.961341 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:17.961809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:17.962235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:18.161824 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:18.175657 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-901c390f-c9ee-43b9-b407-af3fb036f51e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.243482 Sep 26 05:48:18.211466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 229/452] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:17 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:19.204597 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:19.206031 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:19.215413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:19.215915 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:19.216383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:19.217333 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:19.217945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:19.218512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:19.368655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:19.383915 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b42ca222-8065-4613-a4fe-b2174118692b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.177936 Sep 26 05:48:19.384766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 224/453] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:19 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:20.407945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:20.408704 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:20.415431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:20.415896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:20.416324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:20.417011 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:20.417486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:20.418004 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:20.561112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:20.569566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2de47ce5-37c6-4461-91de-4424418635ba tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.165632 Sep 26 05:48:20.570162 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 230/454] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:20 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:21.594222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:21.594911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:21.602478 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:21.603173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:21.603778 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:21.604589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:21.604992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:21.605503 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:21.781759 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:21.791092 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5199d3f7-b835-46fe-87cb-854d35ff1623 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.200636 Sep 26 05:48:21.801979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 225/455] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:21 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:22.821821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:22.821821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:22.829210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=6 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:22.832634 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:22.833608 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:22.834459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:22.836147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:22.836991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:22.837935 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:23.034045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:23.042906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-349f5977-cef3-47a7-9962-24442617cde5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.229088 Sep 26 05:48:23.043479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 231/456] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:22 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:24.065882 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:24.066557 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:24.068420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:24.069088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=6 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:24.075802 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:24.076305 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:24.076741 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:24.077464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:24.077920 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:24.078337 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:24.225721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:24.234383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ae020aa4-6b3a-4083-825e-c8b71a111480 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.172400 Sep 26 05:48:24.234935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 226/457] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:24 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:25.262135 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:25.262769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:25.269572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:25.270034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:25.270470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:25.271154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:25.271590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:25.271997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:25.420983 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:25.429390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ca796943-cf38-432f-8f90-73cadf733a2b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.171040 Sep 26 05:48:25.429979 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 232/458] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:25 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:26.453687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:26.454360 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:26.461998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:26.462573 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:26.463031 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:26.463770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:26.464192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:26.464677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:26.605613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:26.613599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-da39061a-75d7-4ce0-8286-a1a7dc3bdb93 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.163774 Sep 26 05:48:26.614388 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 227/459] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:26 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:27.636233 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:27.636940 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:27.643929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:27.644420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:27.644818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:27.645597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:27.646055 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:27.646473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:27.796441 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:27.805235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-038d3f47-c13c-4eba-85e8-6020ab180f3e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.172673 Sep 26 05:48:27.805873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 233/460] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:27 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:28.828629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:28.829338 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:28.837074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:28.837598 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:28.838014 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:28.838733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:28.839220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:28.839648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:29.026148 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:29.035118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bbe14948-bc7e-4d53-b66e-52d0e70f728b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.210367 Sep 26 05:48:29.035896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 228/461] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:28 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:30.061477 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:30.062181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:30.070225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:30.070877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:30.071416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:30.072834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:30.073257 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:30.073858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:30.234255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:30.242929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ba9dbdeb-ccd9-4938-9cd1-07745613b79a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.187161 Sep 26 05:48:30.243507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 234/462] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:30 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:31.268348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:31.268348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:31.279363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:31.279886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:31.280312 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:31.281094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:31.281603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:31.282022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:31.521686 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:31.535361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-98a10f3b-a9f5-419f-bb5a-360058a6ab74 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.272821 Sep 26 05:48:31.536440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 229/463] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:31 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:31.858073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-81a793b1-ef66-40b7-a6a7-0ddafeb7a1d0 req-a71d683a-ee71-4be5-96a0-605334b1a6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700b7726-3a5c-412e-973f-02740f96edde", "tag": "cfc17f70-ed8d-4384-a96d-8f2f72a15f6d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:31.869373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-81a793b1-ef66-40b7-a6a7-0ddafeb7a1d0 req-a71d683a-ee71-4be5-96a0-605334b1a6d3 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:31.869849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-81a793b1-ef66-40b7-a6a7-0ddafeb7a1d0 req-a71d683a-ee71-4be5-96a0-605334b1a6d3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:31.870258 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-81a793b1-ef66-40b7-a6a7-0ddafeb7a1d0 req-a71d683a-ee71-4be5-96a0-605334b1a6d3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:31.882655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-81a793b1-ef66-40b7-a6a7-0ddafeb7a1d0 req-a71d683a-ee71-4be5-96a0-605334b1a6d3 service nova] Creating event network-changed:cfc17f70-ed8d-4384-a96d-8f2f72a15f6d for instance 700b7726-3a5c-412e-973f-02740f96edde on hv-cinder-83608 Sep 26 05:48:31.888282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-81a793b1-ef66-40b7-a6a7-0ddafeb7a1d0 req-a71d683a-ee71-4be5-96a0-605334b1a6d3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034397 Sep 26 05:48:31.889211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 235/464] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:48:32.574885 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:32.575786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:32.583865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:32.584534 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:32.585115 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:32.586340 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:32.586791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:32.587211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:32.772809 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:32.781738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8dbb535b-3506-4af8-8208-4f402df0c026 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.210995 Sep 26 05:48:32.782555 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 230/465] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:32 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:33.808946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:33.809734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:33.816976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:33.817514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:33.817943 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:33.818669 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:33.819118 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:33.819539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:33.969851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:33.980482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b20e785c-7efd-4dd8-90c2-3c1463abc271 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.175729 Sep 26 05:48:33.981075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 236/466] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:33 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:34.683010 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:34.683915 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:34.690936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:34.691658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:34.692092 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:34.692805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:34.693291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:34.693712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:34.724592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c2606598-688f-4e3a-b56c-11b35fbdd8d7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/ips" status: 200 len: 151 microversion: 2.20 time: 0.045825 Sep 26 05:48:34.725443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 231/467] 10.222.0.57 () {60 vars in 1289 bytes} [Mon Sep 26 05:48:34 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:48:35.004016 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:35.004656 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:35.012007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:35.012486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:35.012882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:35.013627 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:35.014073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:35.014486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:35.209345 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:35.217877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1403230c-8d72-4e6a-a2c6-173f5ac8dd7d tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.217970 Sep 26 05:48:35.218762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 237/468] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:34 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:36.247740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:36.248384 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:36.256527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:36.257022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:36.257491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:36.258192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:36.258651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:36.259086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:36.419956 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:36.428142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-15bd6977-43ea-48f2-919d-6ffa925c4d46 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.185674 Sep 26 05:48:36.428724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 232/469] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:36 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:37.458895 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:37.459916 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:37.471790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:37.472600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:37.473376 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:37.474533 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:37.475286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:37.475985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:37.644465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:37.653725 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3d3512d1-5222-4ba6-924e-0d1557e6eeb9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.204891 Sep 26 05:48:37.654442 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 238/470] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:37 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:38.666474 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-28b2031d-ede1-4286-b830-d7840cb1002a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:38.674363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-28b2031d-ede1-4286-b830-d7840cb1002a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:38.674847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-28b2031d-ede1-4286-b830-d7840cb1002a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:38.675304 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-28b2031d-ede1-4286-b830-d7840cb1002a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:38.699355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:38.700940 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:38.710067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:38.711364 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:38.711862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:38.712859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:38.713498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:38.714136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:38.744893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-28b2031d-ede1-4286-b830-d7840cb1002a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Going to try to stop instance {{(pid=127275) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 05:48:38.797621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-28b2031d-ede1-4286-b830-d7840cb1002a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action" status: 202 len: 0 microversion: 2.1 time: 0.134788 Sep 26 05:48:38.798477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 233/471] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:48:38 2022] POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:48:38.809263 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:38.810543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:38.826655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:38.827445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:38.828163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:38.829355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:38.830116 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:38.830820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:38.906895 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:38.917562 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5684457b-e560-46ac-80cc-e8ebb9fa0b94 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.223821 Sep 26 05:48:38.918464 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 239/472] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:38 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:38.927939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:38.928922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:38.940503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:38.941762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:38.942579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:38.943882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:38.944727 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:38.945529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:38.981947 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lazy-loading 'flavor' on Instance uuid c1734960-6d94-4c7b-b6e4-0556d841388b {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:48:39.004136 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:39.014428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f02ee3a9-86ae-4496-83b4-0650d9ff6858 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.211478 Sep 26 05:48:39.015861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 234/473] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:38 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:39.099266 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:39.236574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-87535cc9-43cd-45cf-a3be-878f905e5a17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/action" status: 202 len: 0 microversion: 2.20 time: 0.316458 Sep 26 05:48:39.237206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 240/474] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Sep 26 05:48:38 2022] POST /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:48:39.249000 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:39.250031 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:39.260142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:39.260929 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:39.261814 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:39.262938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:39.263696 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:39.264259 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:39.402811 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:39.406396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:39.412868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:39.414326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:39.415481 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bb407b2f-1a24-49c2-bdcf-6634028a93d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.173267 Sep 26 05:48:39.416026 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 235/475] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:39 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:39.956873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:39.957603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:39.966643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:39.967350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:39.967806 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:39.968807 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:39.969479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:39.969967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:40.056032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:40.056660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:40.059161 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:40.067054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:40.067560 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:40.068008 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:40.068772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:40.069274 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:40.069713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:40.153471 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:40.162533 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-58c16500-a9af-404a-8edf-b6d050fe5299 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.210083 Sep 26 05:48:40.165226 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 241/476] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:39 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:40.220579 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:40.229411 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d66db1a6-1e31-49ac-8c54-7dfed2c5f928 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.177889 Sep 26 05:48:40.229994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 236/477] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:40 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:40.443504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:40.444031 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:40.451186 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:40.451691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:40.452129 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:40.452876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:40.453384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:40.453814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:40.611391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:40.639927 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:40.641601 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:40.642891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f1eca6fe-564f-45c0-a6b0-07e0758002ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.205695 Sep 26 05:48:40.643481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 242/478] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:40 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:41.190552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:41.191164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:41.198036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:41.198519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:41.198941 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:41.199657 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:41.200105 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:41.200522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:41.260003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:41.260628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:41.263127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:41.268900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:41.269258 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:41.269534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:41.270235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:41.270690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:41.271129 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:41.353444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:41.362837 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f2785cff-22c8-427e-a058-8ec70f2c5b4c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.176332 Sep 26 05:48:41.371456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 237/479] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:41 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:41.424333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:41.435713 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8fc1c653-994a-45de-b8ac-df2ef013e871 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.179408 Sep 26 05:48:41.436748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 243/480] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:41 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:41.673983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:41.674751 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:41.683779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:41.684284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:41.684710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:41.685444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:41.685899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:41.686321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:41.839109 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:41.847567 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:41.848995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:41.850180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-17eaf150-f474-4a6d-b4c4-a7f6b768d1f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.181651 Sep 26 05:48:41.850741 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 238/481] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:41 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:42.385764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:42.386368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:42.393674 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:42.394143 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:42.394575 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:42.395255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:42.395699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:42.396110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:42.467426 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:42.468035 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:42.474743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:42.475232 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:42.475665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:42.476359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:42.476789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:42.477260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:42.536156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:42.544350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-43f77d61-84e9-4c5e-a141-5f0be7993b75 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.162455 Sep 26 05:48:42.545044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 244/482] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:42 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:42.636390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:42.647420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9c706b00-c319-409c-8d26-e50b2a0ad502 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.185131 Sep 26 05:48:42.653562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 239/483] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:42 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:42.875338 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:42.876031 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:42.882654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:42.883134 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:42.883555 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:42.884233 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:42.884675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:42.885082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:43.026037 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:43.034375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:43.035839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:43.036997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-668c04d6-5313-43db-ab97-5538eb29b6f6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.165693 Sep 26 05:48:43.037577 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 245/484] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:42 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:43.578746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:43.579322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:43.586747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:43.587233 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:43.587660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:43.588349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:43.588795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:43.589247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:43.678806 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:43.679519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:43.686422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:43.686891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:43.687337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:43.688024 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:43.688490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:43.688900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:43.734547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:43.742502 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a2309d27-314e-44c4-a1ed-3e83bb249171 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.167635 Sep 26 05:48:43.743085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 240/485] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:43 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:43.833148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:43.845256 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-492324e2-26b1-4b29-a259-3811232788e0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.170244 Sep 26 05:48:43.846003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 246/486] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:43 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:44.063391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:44.064214 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:44.071090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:44.071589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:44.072044 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:44.072726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:44.073210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:44.073626 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:44.221950 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:44.238384 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:44.240159 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:44.241924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3a324af6-6423-42e3-aa19-7748fcbf7a48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.182397 Sep 26 05:48:44.242770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 241/487] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:44 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:44.767419 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:44.768191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:44.775942 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:44.776513 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:44.777046 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:44.778298 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:44.778852 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:44.779413 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:44.873695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:44.874301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:44.881542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:44.882007 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:44.882637 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:44.883310 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:44.883935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:44.884347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:44.927642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:44.936168 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5166ca52-7a32-4bcc-8953-718ccfa9b52e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.173184 Sep 26 05:48:44.936860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 247/488] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:44 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:45.036409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:45.046061 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b89318f3-0e50-47cc-bbab-d342b80949c0 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.176273 Sep 26 05:48:45.046665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 242/489] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:44 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:45.268533 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:45.269499 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:45.277626 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:45.278248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:45.278721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:45.279726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:45.280507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:45.281072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:45.425322 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:45.434711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:45.436278 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:45.437628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-275d51f2-33fa-4a27-a596-28a2741dcd9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.173697 Sep 26 05:48:45.438275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 248/490] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:45 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:45.959860 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:45.960464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:45.968078 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:45.968572 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:45.969009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:45.969800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:45.970256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:45.970681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:46.080584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:46.081354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:46.088893 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:46.089547 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:46.090072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:46.090859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:46.091398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:46.091945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:46.120582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:46.128909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-08a2b395-561a-4ab1-b46a-93fe61dbfcc7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.173188 Sep 26 05:48:46.129529 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 243/491] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:45 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:46.246447 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:46.256350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cf2da55c-30ff-40b5-a2c3-9435053d0bc2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.180031 Sep 26 05:48:46.256935 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 249/492] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:46 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:46.466921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:46.467423 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:46.474075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:46.474557 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:46.474981 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:46.475668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:46.476112 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:46.476524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:46.615865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:46.626678 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:46.628894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:46.630677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-cd8c49cf-cecd-4803-b6ba-0f0499ac6611 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.167770 Sep 26 05:48:46.631530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 244/493] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:46 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:47.152411 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:47.153050 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:47.160539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:47.161033 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:47.161725 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:47.162623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:47.163082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:47.163502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:47.280032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:47.280796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:47.287911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:47.288412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:47.288851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:47.289668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:47.290156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:47.290651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:47.311785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:47.320231 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3d1c773c-9168-4f3d-ad1d-88c1913322b2 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.171965 Sep 26 05:48:47.320781 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 250/494] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:47 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:47.427068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:47.438840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b10dbcf8-d088-4060-9b1b-5ad766af58ee tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.162542 Sep 26 05:48:47.439441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 245/495] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:47 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:47.659677 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:47.660187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:47.669496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:47.670108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:47.670594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:47.671643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:47.676072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:47.676072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:47.824535 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:47.837316 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:47.840648 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:47.842025 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b8eaca0b-b86f-48a6-84e8-e2410fbbbcfc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.186428 Sep 26 05:48:47.842620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 251/496] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:47 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:48.346697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:48.347604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:48.354722 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:48.355293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:48.355767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:48.356505 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:48.356950 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:48.357395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:48.464079 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:48.464797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:48.472183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:48.472784 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:48.473331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:48.474769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:48.475304 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:48.475800 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:48.495974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:48.510649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9ccbd9ba-0a6b-4192-8f1a-70f3c9996f49 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.168089 Sep 26 05:48:48.511363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 246/497] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:48 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:48.638067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:48.654951 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d6b6396b-e22e-48de-9804-beae08a986a7 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.195230 Sep 26 05:48:48.655726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 252/498] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:48 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:48.868480 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:48.869122 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:48.875915 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:48.876422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:48.876856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:48.877641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:48.878119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:48.878546 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:49.038735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:49.047446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:49.048896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:49.050118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-91909a32-30f7-48a6-9f23-6bd18efe8799 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.185787 Sep 26 05:48:49.050687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 247/499] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:48 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:49.534449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:49.535051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:49.541664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:49.542147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:49.542576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:49.543476 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:49.543931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:49.544353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:49.686484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:49.687206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:49.693244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:49.695066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:49.695590 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:49.696034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:49.696743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:49.697225 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:49.697644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:49.703147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9c9eb1b1-7a78-45be-88aa-024b19fc8d78 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.172801 Sep 26 05:48:49.705690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 253/500] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:49 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:49.859951 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:49.869355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-97b55dc1-87e7-4fbf-9a99-66c7bf5acec5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.186712 Sep 26 05:48:49.870030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 248/501] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:49 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:50.076847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:50.080350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:50.083973 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:50.084472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:50.084891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:50.085976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:50.086418 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:50.086825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:50.234327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:50.244636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:50.245343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:50.246853 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-db58c19e-856f-4965-9e17-60925c654304 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.174174 Sep 26 05:48:50.247710 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 254/502] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:50 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:50.555955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-c6a3fcbb-175b-4d99-b78b-90f097bdd53f req-d2887686-fa3c-4dfa-ab86-2fe26ef17f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700b7726-3a5c-412e-973f-02740f96edde", "name": "network-vif-plugged", "status": "completed", "tag": "cfc17f70-ed8d-4384-a96d-8f2f72a15f6d"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:50.569734 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c6a3fcbb-175b-4d99-b78b-90f097bdd53f req-d2887686-fa3c-4dfa-ab86-2fe26ef17f66 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:50.570205 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c6a3fcbb-175b-4d99-b78b-90f097bdd53f req-d2887686-fa3c-4dfa-ab86-2fe26ef17f66 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:50.570628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c6a3fcbb-175b-4d99-b78b-90f097bdd53f req-d2887686-fa3c-4dfa-ab86-2fe26ef17f66 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:50.589775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-c6a3fcbb-175b-4d99-b78b-90f097bdd53f req-d2887686-fa3c-4dfa-ab86-2fe26ef17f66 service nova] Creating event network-vif-plugged:cfc17f70-ed8d-4384-a96d-8f2f72a15f6d for instance 700b7726-3a5c-412e-973f-02740f96edde on hv-cinder-83608 Sep 26 05:48:50.597408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-c6a3fcbb-175b-4d99-b78b-90f097bdd53f req-d2887686-fa3c-4dfa-ab86-2fe26ef17f66 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047714 Sep 26 05:48:50.598407 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 249/503] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:48:50.728891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:50.729799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:50.736961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:50.737451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:50.737879 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:50.738633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:50.739054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:50.739470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:50.894421 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:50.895889 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:50.904241 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:50.904766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:50.905710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:50.906510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:50.906943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:50.907414 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:50.952956 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:50.964877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1ed03daa-f88e-4cb2-82e2-dd6c2c90c519 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.240460 Sep 26 05:48:50.965711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 255/504] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:50 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:51.092216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:51.101334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8d058484-27cc-4795-87c5-8c082ad3e815 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.212325 Sep 26 05:48:51.101922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 250/505] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:50 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:51.273320 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:51.273941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:51.280687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:51.281299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:51.281960 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:51.282664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:51.283115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:51.283700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:51.435946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:51.446313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:51.447887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:51.449086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-61357721-493a-475b-b936-5443a57e0400 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.180170 Sep 26 05:48:51.449760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 256/506] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:51 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:51.990997 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:51.991621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:51.998504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:51.998979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:51.999417 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:52.000113 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:52.000560 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:52.001010 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:52.127160 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:52.127991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:52.134906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:52.135563 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:52.136006 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:52.137301 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:52.137787 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:52.138210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:52.153725 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:52.157871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:52.163977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8677bed9-bd5e-4d2f-abf8-481ac72bb35b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1359 microversion: 2.1 time: 0.176824 Sep 26 05:48:52.164830 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 251/507] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:51 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:52.281511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:52.290364 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-49ba806f-3f36-48ca-998a-304d82639d95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.167615 Sep 26 05:48:52.290963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 257/508] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:52 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:52.475189 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:52.475832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:52.483087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:52.483607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:52.484039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:52.484744 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:52.485223 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:52.485651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:52.625855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:52.635167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:52.636713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:52.638126 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-795e8334-b064-406b-9388-89e131955028 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.166838 Sep 26 05:48:52.639040 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 252/509] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:52 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:53.188163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:53.188896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:53.195961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.196448 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.196871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.197598 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.198041 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.198448 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.315812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:53.316450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:53.323390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.323884 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.324317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.325020 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.325544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.325967 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.330470 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:53.351075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.359485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-47c8499d-04fc-4d97-9ecb-80d2245f5689 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1549 microversion: 2.1 time: 0.175511 Sep 26 05:48:53.360093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 258/510] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:53 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:53.381968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:53.382581 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:53.389396 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.390015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.390327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.391038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.391606 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.391888 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.481977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.490841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2af3df9c-e1c3-4ae2-b8c7-84c9dfcd9a2d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1724 microversion: 2.1 time: 0.178807 Sep 26 05:48:53.491494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 253/511] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:53 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:53.535077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.543371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-46168c51-d98e-46ac-9131-86cc17b277af tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1549 microversion: 2.1 time: 0.165132 Sep 26 05:48:53.543812 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 259/512] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:53 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:53.565695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:53.570660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.571437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Searching by: {'deleted': False, 'project_id': '0b095f1ee00e46cfabebc2dc34992997'} {{(pid=127275) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 26 05:48:53.579018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.579504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.579937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.580661 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.581116 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.581562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.663751 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:53.664373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:53.672276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.673085 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.673574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.674661 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.675176 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.675589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.676088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.multi_cell_list [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127275) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 26 05:48:53.781796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-49e0f885-9020-4a02-bdca-0a9e503aed05 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219990 Sep 26 05:48:53.782389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 254/513] 10.222.0.57 () {58 vars in 1125 bytes} [Mon Sep 26 05:48:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:48:53.794063 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:53.794675 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:53.800681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.801208 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.801634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.802339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:53.802787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:53.803208 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:53.819057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.827382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.828964 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.830231 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7fad33c0-a6c6-4791-96e7-06ecd481f2fb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.170423 Sep 26 05:48:53.830882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 260/514] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:53 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:53.935311 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:53.943640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2e3a9e40-4946-490b-ad50-e40b45d8c73e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1549 microversion: 2.1 time: 0.153361 Sep 26 05:48:53.944218 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 255/515] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:53 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:54.515102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:54.515712 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:54.522702 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:54.523187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:54.523618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:54.524307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:54.524757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:54.525220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:54.856504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:54.857155 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:54.864201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:54.864719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:54.865154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:54.865887 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:54.866345 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:54.866767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:54.918843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:54.927716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-33987e35-986c-4de5-ac9f-ecc7e0c89313 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1701 microversion: 2.1 time: 0.416480 Sep 26 05:48:54.928335 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 261/516] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:54 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1701 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:54.950526 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7d0547a8-625c-447a-a2a8-8ee2fc29ad22 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:54.956802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0547a8-625c-447a-a2a8-8ee2fc29ad22 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:54.957325 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0547a8-625c-447a-a2a8-8ee2fc29ad22 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:54.957760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0547a8-625c-447a-a2a8-8ee2fc29ad22 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:55.004537 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:55.013842 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:55.015587 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:55.016834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ab9f6ea1-628d-4089-a93b-2178029f623c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.164360 Sep 26 05:48:55.017480 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 256/517] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:54 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:55.021803 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7d0547a8-625c-447a-a2a8-8ee2fc29ad22 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Going to try to start instance {{(pid=127274) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 05:48:55.069264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7d0547a8-625c-447a-a2a8-8ee2fc29ad22 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action" status: 202 len: 0 microversion: 2.1 time: 0.122376 Sep 26 05:48:55.070075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 262/518] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:48:54 2022] POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:48:55.078570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:55.079174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:55.085528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:55.086376 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:55.086880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:55.087684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:55.088147 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:55.088566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:55.226420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:55.235364 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0e75ef56-a4de-4bb9-a967-e0d22edd8b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1710 microversion: 2.1 time: 0.160711 Sep 26 05:48:55.236341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 257/519] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:55 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:56.044728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:56.045424 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:56.054092 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:56.054584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:56.055015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:56.055719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:56.056169 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:56.056587 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:56.196915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:56.205999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:56.207444 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:56.208622 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5a1bd4c1-6cfa-4842-9e82-29b6e44bbc5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.168591 Sep 26 05:48:56.209204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 263/520] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:56 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:56.259040 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:56.259619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:56.266369 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:56.266847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:56.267264 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:56.267942 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:56.268384 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:56.268798 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:56.409437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:56.418341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-11c2ca03-19ef-4322-921c-8f0670a30b87 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1710 microversion: 2.1 time: 0.163103 Sep 26 05:48:56.419719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 258/521] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:56 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:48:56.597268 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d19772e8-a73f-419e-94b7-651550e57135"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:56.600702 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:56.607653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:56.608260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:56.608700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:56.609449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:56.609899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:56.610321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:57.237962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:57.238390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:57.244874 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:57.245412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:57.245834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:57.246538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:57.246962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:57.247542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:57.408227 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:57.416916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:57.418426 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:57.419584 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d23e0e27-6b4f-49dd-9389-022a7e783ef6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.187700 Sep 26 05:48:57.423585 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 259/522] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:57 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:57.447443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:57.448409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:57.459693 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:57.460884 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:57.461664 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:57.461942 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-de4b2e9d-6634-4a8f-b715-708bb0109430 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870706 Sep 26 05:48:57.462842 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 264/523] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:48:56 2022] POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:48:57.465353 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:57.465971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:57.466461 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:57.614774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:57.625607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f34138ab-6935-44cc-a8fb-d2de8e6b020b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1714 microversion: 2.1 time: 0.185570 Sep 26 05:48:57.626343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 260/524] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:48:57 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1714 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:48:58.450483 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:58.451184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:58.458451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:58.458829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:58.459256 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:58.459959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:58.460404 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:58.461200 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:58.517477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-199d42de-ef59-4b57-9339-d564fea593d8 req-358e577c-7575-4696-ae85-936d94e75511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1734960-6d94-4c7b-b6e4-0556d841388b", "name": "network-vif-plugged", "status": "completed", "tag": "13bc2cea-45a7-43cc-8730-0f8356ec20ea"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:48:58.528969 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-199d42de-ef59-4b57-9339-d564fea593d8 req-358e577c-7575-4696-ae85-936d94e75511 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:58.529496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-199d42de-ef59-4b57-9339-d564fea593d8 req-358e577c-7575-4696-ae85-936d94e75511 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:58.529934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-199d42de-ef59-4b57-9339-d564fea593d8 req-358e577c-7575-4696-ae85-936d94e75511 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:58.542813 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-199d42de-ef59-4b57-9339-d564fea593d8 req-358e577c-7575-4696-ae85-936d94e75511 service nova] Creating event network-vif-plugged:13bc2cea-45a7-43cc-8730-0f8356ec20ea for instance c1734960-6d94-4c7b-b6e4-0556d841388b on hv-cinder-83608 Sep 26 05:48:58.552605 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-199d42de-ef59-4b57-9339-d564fea593d8 req-358e577c-7575-4696-ae85-936d94e75511 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040630 Sep 26 05:48:58.553211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 261/525] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:48:58.627875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:58.637785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:58.639963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:58.642740 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4d9a4f9d-94e0-4b9f-bd30-04ed8d52a09f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.198763 Sep 26 05:48:58.643426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 265/526] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:58 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:48:59.669571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:59.670952 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:59.676530 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:48:59.677731 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:48:59.689690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:59.690189 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:59.690628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:59.691339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:59.691775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:59.692193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:59.696831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:59.697302 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:59.697782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:59.698534 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:48:59.698988 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:48:59.699452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:48:59.726340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d335549a-fec0-4108-8a64-346993c9a1be tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/ips" status: 200 len: 149 microversion: 2.1 time: 0.053869 Sep 26 05:48:59.726932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 266/527] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:48:59 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:48:59.849874 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:59.858610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:59.860034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:48:59.861247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a481dcda-b80e-443d-ae00-b798a0e07c25 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.196307 Sep 26 05:48:59.861800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 262/528] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:48:59 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:00.891270 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:00.891900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:00.898658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:00.899149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:00.899581 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:00.900279 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:00.900731 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:00.901167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:01.042408 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:01.051719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:01.053211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:01.054372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-747878a9-e973-4a46-9f0c-72ef8cbff0be tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.169660 Sep 26 05:49:01.054936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 267/529] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:00 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:02.082681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:02.083589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:02.094488 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:02.095009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:02.095443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:02.096146 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:02.096599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:02.097022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:02.194794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf0e9365-68ac-4813-9a32-9b38f323ed9a"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:02.197223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:02.204087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:02.204561 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:02.204981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:02.205694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:02.206135 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:02.206541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:02.247527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:02.256654 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:02.258550 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:02.259785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0604f53f-6102-4778-8fab-36e34884eca5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.182635 Sep 26 05:49:02.260335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 263/530] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:02 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:02.519880 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1c4597e5-f053-4d64-be35-d9e665c32419 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328890 Sep 26 05:49:02.520499 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 268/531] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:49:02 2022] POST /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:03.284636 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:03.285510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:03.293433 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:03.294069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:03.294854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:03.295883 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:03.296552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:03.297464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:03.453007 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:03.462965 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:03.465187 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:03.466935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0f637b96-43fb-4d6a-8bdf-2e9b01116a9c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.186075 Sep 26 05:49:03.467749 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 264/532] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:03 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:04.498499 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:04.499357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:04.508439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:04.509032 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:04.509728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:04.510480 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:04.510881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:04.511306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:04.662453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:04.671397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:04.672905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:04.674137 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-13a4cd4f-c9f0-41c1-9eb0-1832f0fb22ef tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.183631 Sep 26 05:49:04.674701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 269/533] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:04 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:05.177782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:05.178414 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:05.181331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:05.190953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:05.191643 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:05.192239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:05.193402 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:05.194138 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:05.194765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:05.331417 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:05.340954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b40b1981-a1f8-4aed-b050-a21858dbe4fb tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1595 microversion: 2.1 time: 0.167179 Sep 26 05:49:05.341594 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 265/534] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:05 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1595 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:05.700194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:05.701327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:05.709599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:05.710093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:05.711035 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:05.711931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:05.712529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:05.713006 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:05.872827 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:05.876882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:05.883434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:05.885008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:05.886297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5220894f-c8ed-476b-ab92-5f70b5379a74 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1745 microversion: 2.20 time: 0.190475 Sep 26 05:49:05.886854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 270/535] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:05 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:06.915859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:06.917183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:06.925081 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:06.925766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:06.926359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:06.927211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:06.927829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:06.928247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:07.342800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:07.360274 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:07.362555 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:07.364199 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-712cbe45-4f56-4cdf-aeb1-86b43d1878c6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.455870 Sep 26 05:49:07.364914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 266/536] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:06 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:07.717710 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-acf285ae-a7f6-4ba9-a05d-85d2a27ad7ef req-5222384b-de6e-40bd-a658-8aba6068765c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700b7726-3a5c-412e-973f-02740f96edde", "tag": "cfc17f70-ed8d-4384-a96d-8f2f72a15f6d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:07.731240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-acf285ae-a7f6-4ba9-a05d-85d2a27ad7ef req-5222384b-de6e-40bd-a658-8aba6068765c service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:07.732497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-acf285ae-a7f6-4ba9-a05d-85d2a27ad7ef req-5222384b-de6e-40bd-a658-8aba6068765c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:07.732939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-acf285ae-a7f6-4ba9-a05d-85d2a27ad7ef req-5222384b-de6e-40bd-a658-8aba6068765c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:07.767118 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-acf285ae-a7f6-4ba9-a05d-85d2a27ad7ef req-5222384b-de6e-40bd-a658-8aba6068765c service nova] Creating event network-changed:cfc17f70-ed8d-4384-a96d-8f2f72a15f6d for instance 700b7726-3a5c-412e-973f-02740f96edde on hv-cinder-83608 Sep 26 05:49:07.780005 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-acf285ae-a7f6-4ba9-a05d-85d2a27ad7ef req-5222384b-de6e-40bd-a658-8aba6068765c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069223 Sep 26 05:49:07.790330 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 271/537] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:08.400646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:08.401352 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:08.421398 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:08.423669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:08.424318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:08.426575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:08.434563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:08.437680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:08.698512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:08.715775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:08.720242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:08.722575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-87a3aaaa-8417-4755-bbbf-769ddd0410ad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.334902 Sep 26 05:49:08.725611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 267/538] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:08 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:09.403165 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2141064964"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:09.411737 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:09.440754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:09.441187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:09.441602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:09.445512 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:09.446439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:09.447417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:09.700153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.network.security_group_api [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Adding security group 614dd8f1-649a-4178-9413-96e4743e870b to port cfc17f70-ed8d-4384-a96d-8f2f72a15f6d Sep 26 05:49:09.757501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:09.759655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:09.767441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:09.768233 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:09.768670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:09.769402 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:09.769887 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:09.770306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:09.936801 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:09.946596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:09.949052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:09.950756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-addf9733-bdd9-413e-832a-9b01d756e969 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.199448 Sep 26 05:49:09.951339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 268/539] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:09 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:49:10.131513 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-56f52fed-b031-462f-985d-69eb9bb7c02f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/action" status: 202 len: 0 microversion: 2.1 time: 0.735575 Sep 26 05:49:10.132341 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 272/540] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:49:09 2022] POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:49:10.141050 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:10.141694 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:10.143976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=66 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:10.149488 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:10.150273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:10.150877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:10.151748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:10.152365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:10.152789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:10.196067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-6c40211a-7859-4066-85b4-98e6afe2f1f1 req-3ab4dc86-53c0-4e01-884e-db2b94ede964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700b7726-3a5c-412e-973f-02740f96edde", "tag": "cfc17f70-ed8d-4384-a96d-8f2f72a15f6d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:10.227007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-6c40211a-7859-4066-85b4-98e6afe2f1f1 req-3ab4dc86-53c0-4e01-884e-db2b94ede964 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:10.236384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-6c40211a-7859-4066-85b4-98e6afe2f1f1 req-3ab4dc86-53c0-4e01-884e-db2b94ede964 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:10.237061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-6c40211a-7859-4066-85b4-98e6afe2f1f1 req-3ab4dc86-53c0-4e01-884e-db2b94ede964 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:10.281467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-6c40211a-7859-4066-85b4-98e6afe2f1f1 req-3ab4dc86-53c0-4e01-884e-db2b94ede964 service nova] Creating event network-changed:cfc17f70-ed8d-4384-a96d-8f2f72a15f6d for instance 700b7726-3a5c-412e-973f-02740f96edde on hv-cinder-83608 Sep 26 05:49:10.291106 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-6c40211a-7859-4066-85b4-98e6afe2f1f1 req-3ab4dc86-53c0-4e01-884e-db2b94ede964 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098550 Sep 26 05:49:10.294986 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 273/541] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:10.543225 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:10.558900 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c0493e97-b923-4692-ae69-0c972bc31abe tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1761 microversion: 2.1 time: 0.421904 Sep 26 05:49:10.559580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 269/542] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:10 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1761 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:10.980378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:10.981374 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:10.988498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:10.989002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:10.989445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:10.990146 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:10.990597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:10.991014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:11.215943 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:11.225324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:11.226767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:11.227937 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-df756a0c-348b-412a-924a-5588a799b3d6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.251882 Sep 26 05:49:11.228539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 274/543] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:10 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:12.254959 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:12.256329 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:12.266584 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:12.267918 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:12.268362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:12.269735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:12.270220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:12.270646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:12.275195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:12.464723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:12.476425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:12.478401 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:12.479791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-efc07eb3-451b-4d4d-bcdf-d475e8edaa4b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.229345 Sep 26 05:49:12.480352 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 270/544] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:12 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:49:12.554799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-249bfb2b-75fb-44d2-9f28-66e1ec5cbb0b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: .version_select at 0x7f1e5e762820>, body: {"keypair": {"name": "tempest-keypair-621968988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDGXZ8amEZ2MTRNu+yRdXp4v4OBfeJr0ENChqjfbywq/okyWn5kAJzUBOtaempnmlkIlWICrY0OSVqY9fCfu24DV/Qwwy6hf9GB7zNn7XZQPqr2qMOdOgBJNA2rLDx2Bg=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:12.561294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=64 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:12.572676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-249bfb2b-75fb-44d2-9f28-66e1ec5cbb0b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:49:12.576576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-249bfb2b-75fb-44d2-9f28-66e1ec5cbb0b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:49:12.604488 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-249bfb2b-75fb-44d2-9f28-66e1ec5cbb0b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052878 Sep 26 05:49:12.606213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 275/545] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:49:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:13.507627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:13.509242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:13.517961 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:13.518990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:13.520381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:13.521342 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:13.522012 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:13.522753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:13.678295 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:13.687360 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:13.688854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:13.690128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2ff97868-611a-41f3-b394-fa122f703f84 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.187255 Sep 26 05:49:13.691056 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 271/546] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:13 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:14.089434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1843918673", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f147de2c-29b4-4f2b-a870-47c60a471f05"}], "security_groups": [{"name": "tempest-securitygroup--289529338"}], "key_name": "tempest-keypair-621968988", "user_data": "}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:14.198654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] validate_networks() for [('f147de2c-29b4-4f2b-a870-47c60a471f05', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:49:14.612002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:49:14.612422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:49:14.612890 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:49:14.613338 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:49:14.613768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:49:14.623169 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:14.623617 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:14.624030 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:14.624756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:14.625275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:14.625699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:14.646775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:49:14.652655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:49:14.665873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:49:14.669838 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:49:14.718946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-82ae66fd-95f1-4cb3-b469-fa33fd5781f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.635058 Sep 26 05:49:14.719955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 276/547] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:49:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:49:14.720729 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:14.721521 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:14.732445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b82a3f21-cf5a-4841-a994-30b6096953b6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:14.733033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:14.733374 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b82a3f21-cf5a-4841-a994-30b6096953b6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:14.733549 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:14.737745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:14.738484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:14.738949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:14.739368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:14.798065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b82a3f21-cf5a-4841-a994-30b6096953b6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:14.806233 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b82a3f21-cf5a-4841-a994-30b6096953b6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1241 microversion: 2.1 time: 0.077149 Sep 26 05:49:14.806233 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 277/548] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:14 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:14.940571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:14.949836 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:14.951647 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:14.953095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6ec62ae0-3526-4b90-8e52-79060cf4528f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.239415 Sep 26 05:49:14.953851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 272/549] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:14 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:15.830972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:15.832357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:15.843584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:15.844089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:15.844523 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:15.845304 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:15.845753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:15.846388 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:15.923265 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:15.931919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-efb1079a-969d-4ee4-97e2-f22cb57cc10b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1293 microversion: 2.1 time: 0.105333 Sep 26 05:49:15.932491 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 278/550] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:15 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:15.979916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:15.980509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:15.987364 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:15.988063 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:15.988700 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:15.989717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:15.990171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:15.990592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:16.137239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:16.145943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:16.147420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:16.148677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-49950973-69f0-4ba1-8309-5cb19845db09 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.172685 Sep 26 05:49:16.149303 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 273/551] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:15 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:16.956914 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:16.958275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:16.966074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:16.966812 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:16.967409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:16.968114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:16.968652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:16.969247 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:17.076758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:17.086129 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5f7d93dd-ecf4-460e-ba1b-0e76d0f73442 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1299 microversion: 2.1 time: 0.132769 Sep 26 05:49:17.088772 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 279/552] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:16 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:17.180745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:17.181464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:17.188649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:17.189449 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:17.190041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:17.190899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:17.191496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:17.192057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:17.354103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:17.363875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:17.365849 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:17.367306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b6d9d2dc-1c4c-482b-89da-6fc4ee295c00 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.190699 Sep 26 05:49:17.385006 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 274/553] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:17 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:18.118594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:18.122478 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:18.138001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:18.139180 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:18.139864 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:18.140812 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:18.142251 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:18.143559 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:18.393749 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:18.395415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:18.409702 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:18.410511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:18.411191 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:18.412116 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:18.413287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:18.415279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:18.417295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:18.443052 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-aa44b922-f40e-45a5-a474-9176972719cd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.330564 Sep 26 05:49:18.448500 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 280/554] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:18 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:18.652720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:18.662709 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:18.664577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:18.666265 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-343d38b6-aedd-4ef3-a1aa-2675f3fd2fc3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.277580 Sep 26 05:49:18.667990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 275/555] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:18 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:18.807342 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-cba49b93-2d6f-46f9-ad61-9533127907d8 req-8986b5f5-20f6-4059-85e1-5185eb5ad143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00537282-21fe-4a1e-ac28-4375d53cb8e6", "tag": "be74a780-bfc1-43dd-84cf-1d45dffcbc7f"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:18.826853 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-cba49b93-2d6f-46f9-ad61-9533127907d8 req-8986b5f5-20f6-4059-85e1-5185eb5ad143 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:18.827705 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-cba49b93-2d6f-46f9-ad61-9533127907d8 req-8986b5f5-20f6-4059-85e1-5185eb5ad143 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:18.828300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-cba49b93-2d6f-46f9-ad61-9533127907d8 req-8986b5f5-20f6-4059-85e1-5185eb5ad143 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:18.842337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-cba49b93-2d6f-46f9-ad61-9533127907d8 req-8986b5f5-20f6-4059-85e1-5185eb5ad143 service nova] Creating event network-changed:be74a780-bfc1-43dd-84cf-1d45dffcbc7f for instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 on hv-cinder-83608 Sep 26 05:49:18.850868 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-cba49b93-2d6f-46f9-ad61-9533127907d8 req-8986b5f5-20f6-4059-85e1-5185eb5ad143 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051682 Sep 26 05:49:18.852196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 281/556] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:19.485565 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:19.486203 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:19.493090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:19.493535 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:19.494155 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:19.495033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:19.495486 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:19.496095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:19.654907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:19.665325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4832a24f-274a-434b-9008-508fc621255e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.183581 Sep 26 05:49:19.666742 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 276/557] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:19 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:19.704479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:19.705479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:19.712261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:19.713211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:19.713876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:19.714774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:19.715451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:19.715978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:19.918521 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:19.928785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:19.934756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:19.936155 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ad98a3f7-5a3d-453e-b67a-d77d7148628b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.237216 Sep 26 05:49:19.936755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 282/558] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:19 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:20.691659 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:20.692283 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:20.699321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:20.699803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:20.700231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:20.700914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:20.701405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:20.701823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:20.845524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:20.853334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-933aba0d-a17b-436f-95e4-83d544f3070d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.165677 Sep 26 05:49:20.853911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 277/559] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:20 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:20.967276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:20.967898 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:20.974919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:20.975411 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:20.975874 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:20.976547 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:20.977003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:20.977455 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:21.136189 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:21.144867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:21.146441 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:21.147608 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-718717c3-a5bf-4ecc-b602-47725ababeb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.184355 Sep 26 05:49:21.148175 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 283/560] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:20 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:21.876760 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:21.877408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:21.884495 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:21.884985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:21.885451 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:21.886156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:21.886612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:21.887033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:22.022092 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:22.030976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a9e90bdc-b936-487b-9b69-93d5e85cb07f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.158118 Sep 26 05:49:22.031806 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 278/561] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:21 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:22.172872 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:22.173462 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:22.180242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:22.180722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:22.181164 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:22.181968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:22.182478 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:22.182936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:22.329489 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:22.342128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:22.344192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:22.345645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-640970d0-0a7a-41fb-b77c-a3e36969bde3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.176921 Sep 26 05:49:22.346186 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 284/562] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:22 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:23.054927 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:23.055494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:23.062387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:23.062881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:23.063309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:23.064033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:23.064483 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:23.064902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:23.210060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:23.219185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d3a81d3b-11cd-493c-a519-c7933de174d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.168276 Sep 26 05:49:23.219759 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 279/563] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:23 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:23.371296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:23.371940 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:23.378656 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:23.379143 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:23.379575 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:23.380277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:23.380724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:23.381170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:23.522092 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:23.530916 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:23.532375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:23.533579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-00f4eaee-dbdd-4449-bd92-ddd9730e8a68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.166268 Sep 26 05:49:23.534143 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 285/564] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:23 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:24.248071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:24.248653 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:24.255268 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:24.255740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:24.256169 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:24.256855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:24.257342 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:24.257752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:24.392671 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:24.400592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5116793d-2024-464b-a5fe-bdb90e63b531 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.156500 Sep 26 05:49:24.401193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 280/565] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:24 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:24.559765 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:24.560513 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:24.568008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:24.568526 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:24.568963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:24.569712 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:24.570181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:24.570599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:24.634098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:24.716149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:24.724738 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:24.726249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:24.727423 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d71e028d-2919-4762-9bd0-c98a2e46042b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1740 microversion: 2.20 time: 0.171659 Sep 26 05:49:24.727978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 286/566] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:24 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:25.424415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:25.425795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:25.432571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:25.433059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:25.433514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:25.434453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:25.434903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:25.435501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:25.469475 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-c8750402-b235-45b5-a350-952584128f72 req-4bca1e5f-13f6-4b84-92a4-4685d67643de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00537282-21fe-4a1e-ac28-4375d53cb8e6", "name": "network-vif-plugged", "status": "completed", "tag": "be74a780-bfc1-43dd-84cf-1d45dffcbc7f"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:25.483434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=12 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:25.489426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-c8750402-b235-45b5-a350-952584128f72 req-4bca1e5f-13f6-4b84-92a4-4685d67643de service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:25.497989 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-c8750402-b235-45b5-a350-952584128f72 req-4bca1e5f-13f6-4b84-92a4-4685d67643de service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:25.498835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-c8750402-b235-45b5-a350-952584128f72 req-4bca1e5f-13f6-4b84-92a4-4685d67643de service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:25.515365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-c8750402-b235-45b5-a350-952584128f72 req-4bca1e5f-13f6-4b84-92a4-4685d67643de service nova] Creating event network-vif-plugged:be74a780-bfc1-43dd-84cf-1d45dffcbc7f for instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 on hv-cinder-83608 Sep 26 05:49:25.521020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-c8750402-b235-45b5-a350-952584128f72 req-4bca1e5f-13f6-4b84-92a4-4685d67643de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055357 Sep 26 05:49:25.521928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 287/567] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:49:25.613380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:25.622325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-afcf2521-5b54-4580-b856-cf2223117f3b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.202042 Sep 26 05:49:25.634459 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 281/568] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:25 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:25.755593 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:25.756268 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:25.764388 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:25.764925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:25.765492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:25.766126 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:25.766755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:25.767147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:25.937298 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:25.945941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:25.947300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:25.948453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ea732f9f-eb64-4f31-9302-89ef04effe97 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1722 microversion: 2.20 time: 0.199771 Sep 26 05:49:25.949040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 288/569] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:25 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:26.710924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:26.711681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:26.720272 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:26.720758 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:26.721211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:26.721914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:26.722358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:26.722831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:26.865890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:26.874049 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-976dc7e5-2472-42b0-9917-809903bdc579 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1366 microversion: 2.1 time: 0.231278 Sep 26 05:49:26.874626 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 282/570] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:26 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:27.092428 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:27.093095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:27.102128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:27.102850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:27.103512 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:27.104618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:27.105470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:27.106110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:27.255639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:27.264887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:27.266564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:27.267760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-56398707-cb96-474a-86b9-0153966140fd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1722 microversion: 2.20 time: 0.297169 Sep 26 05:49:27.279859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 289/571] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:26 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:27.897655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:27.898238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:27.905041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:27.905551 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:27.905980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:27.906673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:27.907143 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:27.907565 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:28.060622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:28.071013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-31b588a2-0143-472f-a952-66d436a92d5c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1556 microversion: 2.1 time: 0.176987 Sep 26 05:49:28.071894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 283/572] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:49:27 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:49:28.096264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:28.096871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:28.104308 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:28.104817 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:28.105246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:28.105974 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:28.106395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:28.106844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:28.187826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b5bb87c2-b140-487f-a8bb-b2e790b2eb2a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096394 Sep 26 05:49:28.188430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 290/573] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:49:28 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:28.300237 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:28.300806 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:28.307292 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:28.307784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:28.308220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:28.308890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:28.309607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:28.310035 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:28.449232 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:28.457774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:28.459342 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:28.460848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-18b3e631-45b2-40ba-8499-e39fae046898 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1722 microversion: 2.20 time: 0.164423 Sep 26 05:49:28.461440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 284/574] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:28 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:29.172737 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-971c37f7-1032-4155-886f-3297fe344551 req-9f4ca323-8333-4996-9879-b1e37ccca77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00537282-21fe-4a1e-ac28-4375d53cb8e6", "tag": "be74a780-bfc1-43dd-84cf-1d45dffcbc7f"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:29.182731 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-971c37f7-1032-4155-886f-3297fe344551 req-9f4ca323-8333-4996-9879-b1e37ccca77a service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:29.183285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-971c37f7-1032-4155-886f-3297fe344551 req-9f4ca323-8333-4996-9879-b1e37ccca77a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:29.183774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-971c37f7-1032-4155-886f-3297fe344551 req-9f4ca323-8333-4996-9879-b1e37ccca77a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:29.195288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-971c37f7-1032-4155-886f-3297fe344551 req-9f4ca323-8333-4996-9879-b1e37ccca77a service nova] Creating event network-changed:be74a780-bfc1-43dd-84cf-1d45dffcbc7f for instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 on hv-cinder-83608 Sep 26 05:49:29.200390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-971c37f7-1032-4155-886f-3297fe344551 req-9f4ca323-8333-4996-9879-b1e37ccca77a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Sep 26 05:49:29.201001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 291/575] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:29.486243 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:29.486834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:29.493682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:29.494172 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:29.494604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:29.495301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:29.495737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:29.496183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:29.544887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-436ebd55-7c5a-4018-ac67-3e0be1e52c31 req-6b6700ed-9859-4e32-9b99-f686f73e32cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1734960-6d94-4c7b-b6e4-0556d841388b", "name": "network-vif-unplugged", "status": "completed", "tag": "13bc2cea-45a7-43cc-8730-0f8356ec20ea"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:29.565383 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-436ebd55-7c5a-4018-ac67-3e0be1e52c31 req-6b6700ed-9859-4e32-9b99-f686f73e32cb service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:29.565858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-436ebd55-7c5a-4018-ac67-3e0be1e52c31 req-6b6700ed-9859-4e32-9b99-f686f73e32cb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:29.566249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-436ebd55-7c5a-4018-ac67-3e0be1e52c31 req-6b6700ed-9859-4e32-9b99-f686f73e32cb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:29.584850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-436ebd55-7c5a-4018-ac67-3e0be1e52c31 req-6b6700ed-9859-4e32-9b99-f686f73e32cb service nova] Creating event network-vif-unplugged:13bc2cea-45a7-43cc-8730-0f8356ec20ea for instance c1734960-6d94-4c7b-b6e4-0556d841388b on hv-cinder-83608 Sep 26 05:49:29.599791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-436ebd55-7c5a-4018-ac67-3e0be1e52c31 req-6b6700ed-9859-4e32-9b99-f686f73e32cb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064388 Sep 26 05:49:29.601227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 292/576] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:49:29.661512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:29.670499 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:29.671961 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:29.673239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5ec6e213-03df-479d-afd6-81de1699d63f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1722 microversion: 2.20 time: 0.190882 Sep 26 05:49:29.673800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 285/577] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:29 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:30.701716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:30.702324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:30.708865 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:30.709487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:30.709924 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:30.710994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:30.711445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:30.711873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:30.882457 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:30.891181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:30.892601 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:30.893978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5423fa41-6d74-4e14-80ef-6af1f8f5e448 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1725 microversion: 2.20 time: 0.197173 Sep 26 05:49:30.894721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 293/578] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:30 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:30.919720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6164fce8-dd68-4d37-b29b-cf1744d34c45"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:30.922853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:30.929855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:30.930264 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:30.930913 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:30.931606 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:30.932015 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:30.932428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:31.010711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=100 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:31.242696 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dfa8185c-9ce4-4198-b8a9-cfa016153af4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327169 Sep 26 05:49:31.243875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 286/579] 10.222.0.57 () {62 vars in 1364 bytes} [Mon Sep 26 05:49:30 2022] POST /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:49:31.383786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:49:31.384570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:31.393925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:31.394520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:31.395132 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:31.396175 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:31.396690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:31.397264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:31.497192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127274) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 05:49:31.526815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:31.575047 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5fa38eeb-774c-401e-9ad2-40caa4f056f8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/action" status: 202 len: 0 microversion: 2.20 time: 0.197626 Sep 26 05:49:31.575651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 294/580] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Sep 26 05:49:31 2022] POST /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:49:31.584230 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:31.584848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:31.592295 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:31.592784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:31.593254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:31.594010 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:31.594470 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:31.594891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:31.735856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:31.744914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:31.746374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:31.747548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3bd30136-be16-4f1c-9392-3b0fac54bef9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1751 microversion: 2.20 time: 0.167302 Sep 26 05:49:31.748143 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 287/581] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:31 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:32.774075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:32.774858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:32.781074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:32.781651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:32.782100 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:32.782899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:32.783362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:32.783787 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:32.918807 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:32.930264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:32.931694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:32.932996 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b2abf82b-d109-44cf-b8a2-ad88e70673b2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1753 microversion: 2.20 time: 0.163481 Sep 26 05:49:32.933782 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 295/582] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:32 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:33.959200 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:33.960227 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:33.967201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:33.967807 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:33.968730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:33.969642 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:33.970021 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:33.970692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:34.117289 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:34.126475 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:34.127908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:34.129185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-97f277a4-c6dc-482e-9ef4-f2592490613e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.174339 Sep 26 05:49:34.129820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 288/583] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:33 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:35.155416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:35.156228 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:35.163401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:35.163885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:35.164311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:35.164982 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:35.165493 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:35.165905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:35.404993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:35.415587 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:35.417162 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:35.418348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-92ddf575-5f86-4bb5-a669-411141c540f5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.266928 Sep 26 05:49:35.418893 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 296/584] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:35 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:36.445973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:36.446906 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:36.458438 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:36.458932 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:36.459366 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:36.460066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:36.460879 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:36.461332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:36.615829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:36.625302 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:36.626740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:36.627888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-89923fa8-fc52-4eed-bc84-33430187e69e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.187646 Sep 26 05:49:36.628441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 289/585] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:36 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:37.654160 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:37.654909 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:37.662047 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:37.662542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:37.662961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:37.663672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:37.664121 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:37.664559 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:37.839519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:37.851324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:37.852795 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:37.854136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7ef34ace-8a1b-4ef2-9ef9-369e775c192f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.203950 Sep 26 05:49:37.854775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 297/586] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:37 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:38.898088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:38.898696 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:38.906372 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:38.906911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:38.907544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:38.908276 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:38.908750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:38.909182 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:39.073776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:39.082937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:39.084357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:39.085944 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-285c1983-b3e2-454e-8db0-e051f7d49e91 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.191521 Sep 26 05:49:39.086501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 290/587] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:38 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:40.112805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:40.115614 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:40.125936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:40.126828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:40.127532 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:40.128508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:40.129152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:40.129817 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:40.274378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:40.283946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:40.285411 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:40.286643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-73474e93-bf86-491f-a40d-6a9986f75429 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.178432 Sep 26 05:49:40.287212 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 298/588] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:40 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:41.315119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:41.315800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:41.319531 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=44 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:41.330232 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:41.331118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:41.331897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:41.333157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:41.333958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:41.334458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:41.502603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:41.511868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:41.513443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:41.514665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ea9307f6-9877-4823-858c-c6de7be37cd0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.204618 Sep 26 05:49:41.515491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 291/589] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:41 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:42.540372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:42.541285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:42.556123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:42.558429 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:42.560028 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:42.560820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:42.561324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:42.561749 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:42.711425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:42.721555 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:42.723153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:42.724518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-287dc50c-541e-4b2e-8de1-7db7f3aad0c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.188136 Sep 26 05:49:42.731714 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 299/590] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:42 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:43.750568 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:43.751251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:43.770629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:43.771120 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:43.771542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:43.772239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:43.772688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:43.773100 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:43.915049 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:43.925800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:43.927239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:43.928399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-32c3c39a-1289-49e4-bc68-6bc4d5a53e7e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.182221 Sep 26 05:49:43.928964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 292/591] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:43 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:44.953476 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:44.954774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:44.956706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:44.962433 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:44.962935 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:44.963372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:44.964075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:44.964505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:44.964914 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:45.107406 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:45.116490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:45.118045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:45.119298 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-75a340f8-19a3-4e05-9ea3-6dc2d54ff6e7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.170212 Sep 26 05:49:45.120274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 300/592] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:44 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:49:46.144318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:46.145075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:46.151783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:46.152278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:46.152715 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:46.153585 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:46.154088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:46.154607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:46.292319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:46.302903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:46.304377 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:46.305713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b5adbaa4-4d26-43b1-8495-6bd6b121922d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.165492 Sep 26 05:49:46.321052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 293/593] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:46 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:47.332269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:47.333028 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:47.342916 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:47.343432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:47.344028 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:47.345242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:47.345908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:47.346558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:47.490028 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:47.500224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:47.501820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:47.503044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4975d046-6ead-447f-8213-b6a674955c73 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.175230 Sep 26 05:49:47.503596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 301/594] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:47 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:48.530850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:48.531526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:48.538934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:48.539418 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:48.539856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:48.540860 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:48.541712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:48.542385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:48.685331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:48.696650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:48.698026 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:48.699223 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c09db45e-1723-4614-abe4-27ef344d7b96 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.172378 Sep 26 05:49:48.699783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 294/595] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:48 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:49.732983 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:49.733686 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:49.740514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:49.741036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:49.741490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:49.742184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:49.742633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:49.743078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:49.891081 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:49.900459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:49.901960 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:49.903143 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b492b97e-e21e-4065-9637-8f5f793ba154 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.174200 Sep 26 05:49:49.903707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 302/596] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:49 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:50.929787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:50.930398 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:50.939112 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:50.939664 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:50.940124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:50.940871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:50.941396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:50.941823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:51.103243 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:51.112703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:51.114229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:51.115387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d667ebbe-8711-4ff1-a58d-8d044da7251c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.190257 Sep 26 05:49:51.115952 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 295/597] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:50 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:52.141387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:52.142008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:52.149845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:52.150324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:52.150774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:52.151459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:52.151903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:52.152339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:52.291834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:52.301301 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:52.302899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:52.304252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-74cb5a8b-7d6a-4808-b233-cfcba0e6aa62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.167059 Sep 26 05:49:52.304809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 303/598] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:52 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:53.330228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:53.330837 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:53.338257 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:53.338744 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:53.339179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:53.339885 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:53.340332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:53.340754 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:53.480697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:53.490578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:53.492037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:53.493125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-02b49ac7-bdde-4590-84f2-df7b6e764e5d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.166888 Sep 26 05:49:53.493677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 296/599] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:53 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:54.519872 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:54.520462 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:54.527694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:54.528178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:54.528609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:54.529334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:54.529781 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:54.530194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:54.680362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:54.689948 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:54.691431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:54.692684 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-31b37a01-04f4-45a1-b994-5ecfa8ef4c5c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.177555 Sep 26 05:49:54.693337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 304/600] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:54 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:55.723369 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:55.724028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:55.730465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:55.730954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:55.731386 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:55.732087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:55.732559 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:55.732980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:55.870888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:55.880612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:55.882048 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:55.883246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3f651047-0bd1-4de1-a623-90f8dbad4b7d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.165734 Sep 26 05:49:55.883809 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 297/601] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:55 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:56.911847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:56.912628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:56.919348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:56.919843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:56.920271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:56.920962 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:56.921527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:56.921942 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:57.061497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:57.071088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:57.072520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:57.073747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-29760b97-1a74-4585-9891-46bd87028285 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.166978 Sep 26 05:49:57.074310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 305/602] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:56 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:58.100164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:58.100964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:58.107738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:58.108241 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:58.108666 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:58.109407 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:58.109862 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:58.110264 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:58.256720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:58.265726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:58.267167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:58.268330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f1c9d420-8677-4074-80b1-518348052e48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.172441 Sep 26 05:49:58.268969 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 298/603] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:58 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:49:59.296482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:49:59.297113 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:49:59.306905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:59.307484 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:59.308011 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:59.308766 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:49:59.309353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:49:59.309783 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:49:59.449728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:59.463500 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:59.465515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:49:59.467334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2580be3b-81fa-49bb-b79f-fa1bf04b6a20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.176661 Sep 26 05:49:59.468236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 306/604] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:49:59 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:00.492996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:00.493618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:00.500834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:00.501346 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:00.501780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:00.502476 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:00.502931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:00.503353 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:00.641106 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:00.650251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:00.651681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:00.652818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-87cb3ec1-b593-4e89-8bf3-7751b22cc917 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.164074 Sep 26 05:50:00.653373 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 299/605] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:50:00 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:01.678683 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:01.679470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:01.688055 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:01.688863 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:01.689426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:01.690626 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:01.691915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:01.692014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:01.694815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:01.831507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:01.842268 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:01.843726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:01.844883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6a8a2604-4a09-4073-bf1d-9da3bc5eebbd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.170217 Sep 26 05:50:01.845471 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 307/606] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:50:01 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:02.872952 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:02.873658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:02.882331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:02.882826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:02.883260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:02.883985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:02.884375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:02.884796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:02.887439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:03.016707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:03.027137 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:03.028571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:03.029778 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-418c5728-57c4-4438-99e7-6e7eb7711838 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.162695 Sep 26 05:50:03.030335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 300/607] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:50:02 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:03.661305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-52d73eae-3106-45be-bd24-524300e43e1b req-773d9074-5616-49e4-a811-b425f15199ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1734960-6d94-4c7b-b6e4-0556d841388b", "name": "network-vif-plugged", "status": "completed", "tag": "13bc2cea-45a7-43cc-8730-0f8356ec20ea"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:03.671756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-52d73eae-3106-45be-bd24-524300e43e1b req-773d9074-5616-49e4-a811-b425f15199ea service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:03.672272 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-52d73eae-3106-45be-bd24-524300e43e1b req-773d9074-5616-49e4-a811-b425f15199ea service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:03.672753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-52d73eae-3106-45be-bd24-524300e43e1b req-773d9074-5616-49e4-a811-b425f15199ea service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:03.684320 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-52d73eae-3106-45be-bd24-524300e43e1b req-773d9074-5616-49e4-a811-b425f15199ea service nova] Creating event network-vif-plugged:13bc2cea-45a7-43cc-8730-0f8356ec20ea for instance c1734960-6d94-4c7b-b6e4-0556d841388b on hv-cinder-83608 Sep 26 05:50:03.689622 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-52d73eae-3106-45be-bd24-524300e43e1b req-773d9074-5616-49e4-a811-b425f15199ea service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032294 Sep 26 05:50:03.690257 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 308/608] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:50:04.056446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:04.057245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:04.064164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:04.064660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:04.065056 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:04.065783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:04.066229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:04.066639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:04.205853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:04.216527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:04.218123 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:04.219232 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3460e628-911b-4a14-b197-243433a6156d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.166730 Sep 26 05:50:04.220309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 301/609] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:50:04 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:05.245462 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:05.246149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:05.252698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:05.253202 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:05.253661 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:05.254387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:05.255127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:05.255552 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:05.412506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:05.422287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:05.423770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:05.425071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7d6fb362-3c5e-4e3a-a0f9-e5958f00b724 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.184582 Sep 26 05:50:05.425647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 309/610] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:50:05 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:06.177358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fcda20c-9df8-456d-8402-a9372f393c19"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:06.180230 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:06.187430 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:06.187953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:06.188387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:06.189260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:06.189694 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:06.190174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:06.452706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:06.453427 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:06.463690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:06.464181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:06.464617 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:06.465361 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:06.465820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:06.466221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:06.604740 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:06.620050 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:06.622243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:06.623928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9fc10038-18fb-4ef6-906e-a236de9ab22e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1809 microversion: 2.20 time: 0.176334 Sep 26 05:50:06.624718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 310/611] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:50:06 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:06.959325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8b08a5db-e166-40fb-aaed-2d25252ea751 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890909 Sep 26 05:50:06.959674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 302/612] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:50:06 2022] POST /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:50:07.652347 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:07.653005 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:07.659955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:07.660437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:07.660988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:07.661754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:07.662202 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:07.662624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:07.799243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:07.808044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:07.809507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:07.810674 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7f24cb04-ae7f-43da-9620-476ca1567bdb tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1796 microversion: 2.20 time: 0.163181 Sep 26 05:50:07.811226 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 311/613] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:50:07 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1796 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:50:14.545120 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:14.547524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:14.549675 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=24 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:14.555761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:14.556200 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:14.556504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:14.557284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:14.557726 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:14.558175 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:14.581581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lazy-loading 'flavor' on Instance uuid a09331c3-4186-46a6-abeb-f3e5ef0ec10d {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:50:14.724368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ef2af8ff-c27d-415f-b71c-84ecd2ea6611 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/action" status: 200 len: 32 microversion: 2.1 time: 0.184290 Sep 26 05:50:14.724871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 303/614] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:50:14 2022] POST /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:50:14.734779 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:14.735469 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:14.741758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:14.742216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:14.742647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:14.743332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:14.743777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:14.744196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:14.967428 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:14.976557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8607f210-9a8f-4820-a14e-9da2b0a3cb63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.245571 Sep 26 05:50:14.977017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 312/615] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:14 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:16.001875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:16.002607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:16.010216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:16.010706 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:16.011141 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:16.011938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:16.012475 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:16.012893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:16.157805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:16.166840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-320e1919-30aa-4f16-bd40-d172d877d70e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.169833 Sep 26 05:50:16.167510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 304/616] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:15 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:17.192415 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:17.193010 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:17.195432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=26 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:17.201240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:17.201726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:17.202158 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:17.202829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:17.203277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:17.203691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:17.341178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:17.349594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-dd6dbf7a-a3fd-4aa6-9e46-0607dde70e78 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.161212 Sep 26 05:50:17.350166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 313/617] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:17 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:18.375111 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:18.375718 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:18.382702 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:18.383185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:18.383620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:18.384325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:18.384783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:18.385238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:18.530004 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:18.542441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f5fa0f3d-63cc-41fa-a14e-1548ee1c4c69 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.172194 Sep 26 05:50:18.543247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 305/618] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:18 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:19.566795 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:19.567422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:19.574450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:19.574929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:19.575394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:19.576066 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:19.576528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:19.576950 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:19.725261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:19.734012 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7afb36f3-0723-4820-b4d1-931963b11bc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.171165 Sep 26 05:50:19.734958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 314/619] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:19 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:20.759536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:20.760320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:20.767403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:20.767891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:20.768330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:20.769039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:20.769529 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:20.769954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:20.908545 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:20.917205 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ed454508-e814-4657-8fd3-7b8528292e83 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.162500 Sep 26 05:50:20.917785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 306/620] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:20 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:21.941069 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:21.941717 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:21.948814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:21.949346 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:21.949773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:21.950479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:21.950931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:21.951348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:22.088152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:22.096794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d5ebf093-1e52-4177-9081-93ff2d8e3b77 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.159663 Sep 26 05:50:22.097409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 315/621] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:21 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:23.120937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:23.121647 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:23.128532 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:23.129037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:23.129483 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:23.130171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:23.130610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:23.131018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:23.273492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:23.282653 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e9c22f12-f0da-43ec-ba26-a210ae13b9ab tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.165654 Sep 26 05:50:23.283419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 307/622] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:23 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:24.308771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:24.309450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:24.316782 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:24.317236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:24.317678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:24.318407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:24.318860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:24.319282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:24.456170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:24.465013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8aa6fabf-052b-45fe-a6c0-32164bc43141 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.162095 Sep 26 05:50:24.465612 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 316/623] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:24 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:25.489471 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:25.490314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:25.497591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:25.498048 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:25.498608 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:25.499323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:25.499784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:25.500206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:25.652766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:25.661945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-62583cde-148e-44b1-b24b-8d6aa65b1c3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.176501 Sep 26 05:50:25.662500 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 308/624] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:25 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:26.686107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:26.686684 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:26.693920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:26.694412 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:26.694834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:26.695538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:26.695994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:26.696409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:26.834152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:26.847002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-24b902ff-1860-4f75-8ddb-fcbe694f0e63 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.164757 Sep 26 05:50:26.847757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 317/625] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:26 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:27.874590 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:27.875338 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:27.882413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:27.882905 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:27.883314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:27.884046 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:27.884501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:27.884922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:28.028605 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:28.038636 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-306273ed-d957-4c9e-8fea-e257ef74a7dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.168309 Sep 26 05:50:28.039207 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 309/626] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:27 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:28.157307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:28.157854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:28.166372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:28.167078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:28.167659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:28.168595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:28.169297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:28.169844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:28.298827 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lazy-loading 'services' on Instance uuid a0853094-da33-4e22-a597-b0df1980229b {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:50:28.421604 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-efc227cb-f3d0-4865-af87-712434224241 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-volume_attachments/c2f925ed-c2de-4af5-8935-26d419e74567" status: 202 len: 0 microversion: 2.1 time: 0.374835 Sep 26 05:50:28.422404 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 318/627] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:50:28 2022] DELETE /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-volume_attachments/c2f925ed-c2de-4af5-8935-26d419e74567 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:50:29.062186 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:29.062824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:29.070966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:29.070966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:29.070966 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:29.071539 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:29.071864 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:29.072276 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:29.220408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:29.230452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-812a9504-92f6-467b-b841-ada988c9852d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.172111 Sep 26 05:50:29.231166 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 310/628] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:29 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:30.256293 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:30.257249 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:30.266780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:30.267311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:30.267733 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:30.268444 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:30.268900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:30.269363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:30.409633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:30.420892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-abc8f088-f54e-4945-bc81-cd7c9f74d9ea tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.169667 Sep 26 05:50:30.421479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 319/629] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:30 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:50:30.612775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-36ee6770-3330-4021-a71a-019732e9da5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:30.621845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36ee6770-3330-4021-a71a-019732e9da5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:30.622576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36ee6770-3330-4021-a71a-019732e9da5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:30.623257 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36ee6770-3330-4021-a71a-019732e9da5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:30.652360 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-36ee6770-3330-4021-a71a-019732e9da5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Going to try to stop instance {{(pid=127275) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 05:50:30.699833 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-36ee6770-3330-4021-a71a-019732e9da5d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action" status: 202 len: 0 microversion: 2.1 time: 0.091767 Sep 26 05:50:30.700585 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 311/630] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:50:30 2022] POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:50:30.709078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:30.709707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:30.716435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:30.716945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:30.717421 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:30.718194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:30.718710 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:30.719072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:30.854384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:30.862443 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c6d44310-6d72-41b0-a203-742925eff039 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.157306 Sep 26 05:50:30.863035 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 320/631] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:30 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:31.446357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:31.447050 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:31.454744 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:31.455221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:31.455660 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:31.456381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:31.456839 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:31.457304 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:31.475576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:31.609554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:31.622709 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3813d092-7721-4fed-aa5c-bf12034e5e85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.180413 Sep 26 05:50:31.624687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 312/632] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:31 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:31.887069 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:31.887655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:31.894739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:31.895223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:31.895654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:31.896337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:31.896789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:31.897251 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:31.899896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:32.040044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:32.048125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4a37eec7-b333-4bdf-9901-7b7a8796ff97 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.165046 Sep 26 05:50:32.048683 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 321/633] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:31 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:32.647861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:32.648491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:32.655928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:32.656427 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:32.656858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:32.657630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:32.658086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:32.658512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:32.797025 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:32.806183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-00fddbbc-b9e4-42a8-b9a2-30ad98c4c0c6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.162235 Sep 26 05:50:32.806772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 313/634] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:32 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:33.071976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:33.072614 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:33.079507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:33.079986 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:33.080441 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:33.081128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:33.081606 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:33.082016 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:33.225074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:33.233260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f3fde369-6fa6-48bb-ac8c-68b0079e378e tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.165106 Sep 26 05:50:33.233844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 322/635] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:33 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:33.830229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:33.830910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:33.841690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:33.842846 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:33.843556 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:33.844756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:33.845724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:33.846558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:33.999658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:34.008663 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e31a0967-5a23-4db7-89a1-842ab6b1133b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.182401 Sep 26 05:50:34.009284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 314/636] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:33 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:34.258156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:34.258799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:34.265688 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:34.266174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:34.266694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:34.267400 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:34.267851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:34.268271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:34.410926 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:34.419397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-516c3143-99b4-4516-b958-f9a2261d3231 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.165308 Sep 26 05:50:34.420002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 323/637] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:34 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:35.032916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:35.033729 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:35.041588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:35.042227 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:35.045047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:35.045883 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:35.046359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:35.046790 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:35.193631 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:35.202349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dff25c98-976b-418c-95ec-6195bda485fd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1734 microversion: 2.1 time: 0.173509 Sep 26 05:50:35.202934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 315/638] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:35 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:35.443394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:35.444016 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:35.450910 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:35.451430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:35.452007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:35.452784 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:35.453339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:35.453846 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:35.594788 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:35.603371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5d284f84-ce5d-4554-a9bb-c21d63606c69 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.163803 Sep 26 05:50:35.604054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 324/639] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:35 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:36.226114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:36.226757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:36.234127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.234659 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.235041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.235799 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.236305 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.236901 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.379758 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:36.389650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6452ce60-5f52-4ce7-a717-1cdbe5fcb0b3 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1714 microversion: 2.1 time: 0.167403 Sep 26 05:50:36.390238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 316/640] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:36 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:36.507159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:36.508000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:36.518680 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.519540 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.520294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.521564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.522381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.523128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.616984 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] HTTP exception thrown: Cannot 'detach_volume' instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d while it is in vm_state rescued Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Request method failure captured: Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: DELETE /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments/8fcda20c-9df8-456d-8402-a9372f393c19 HTTP/1.1 Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTwuaeuiG1qEQW0yjIPlpAPCpETHlr3RkHfKHI77C36DLeEjWyQ-XCnBZEZlkc1WqJ97pFpT_tY7DIlUs-AKhwH8GY1zD-qTM2D8gX9po477irnUEgFVnpKPjqMdxNkYYhTcRBEpUSbqPfEPbkUdDdvjbjIYTsK27n7S_vPXUyYuY3o Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:50:36.618636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c95cba08e61d4d199a3c69d99c5bc77b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 342ce12282264d40b2f2bb6f1fc6ba25 Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:50:36.620215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Cannot 'detach_volume' instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d while it is in vm_state rescued Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'server_id': 'a09331c3-4186-46a6-abeb-f3e5ef0ec10d', 'id': '8fcda20c-9df8-456d-8402-a9372f393c19'} Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:50:36.621719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d while it is in vm_state rescued Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d while it is in vm_state rescued Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:50:36.623173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Returning 409 to user: Cannot 'detach_volume' instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d while it is in vm_state rescued {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:50:36.624333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-524cca52-ae6d-4a31-bdf1-dd3920305f80 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments/8fcda20c-9df8-456d-8402-a9372f393c19" status: 409 len: 152 microversion: 2.1 time: 0.120505 Sep 26 05:50:36.624333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 325/641] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:50:36 2022] DELETE /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments/8fcda20c-9df8-456d-8402-a9372f393c19 => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 05:50:36.630631 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:36.630853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:36.631350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:36.631921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:36.637676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.638167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.638601 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.639303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.639758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.640179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.641922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.642799 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.643581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.647491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.647491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.647491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.733059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8b304c66-176b-4620-be5a-9551a5735399 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "POST /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/action" status: 202 len: 0 microversion: 2.1 time: 0.107105 Sep 26 05:50:36.734311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 326/642] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:50:36 2022] POST /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:50:36.747651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:36.748902 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:36.759946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.760514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.761210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.762426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:36.763205 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:36.763915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:36.824286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:36.832764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ff9ce8ac-3487-4d13-baf5-05e60b5ee145 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.207722 Sep 26 05:50:36.833405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 317/643] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:36 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:37.003192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:37.012767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d0320632-f274-4f50-b787-c049112e6503 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1722 microversion: 2.1 time: 0.272864 Sep 26 05:50:37.013362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 327/644] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:36 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:50:37.858280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:37.858907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:37.866935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:37.867543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:37.867970 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:37.868715 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:37.869228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:37.869652 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:38.005960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:38.014279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2505c5f8-df0a-481e-9bb9-97e8168ca1cd tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.160039 Sep 26 05:50:38.014963 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 318/645] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:37 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:38.035983 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:38.036797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:38.044531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:38.045172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:38.045740 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:38.046615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:38.047153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:38.047766 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:38.190977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:38.199569 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5fbf3dfc-30b7-4de7-bb4d-b2a63807149d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1722 microversion: 2.1 time: 0.167505 Sep 26 05:50:38.200365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 328/646] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:38 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:39.038739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:39.039513 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:39.046865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:39.047359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:39.047920 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:39.048825 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:39.049426 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:39.050008 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:39.195692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:39.204196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-afa79b3f-a3cb-413a-a6e5-e9d8979c0082 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.169546 Sep 26 05:50:39.204956 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 319/647] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:39 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:39.228261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:39.228867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:39.236051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:39.236551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:39.237012 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:39.237773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:39.238250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:39.238675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:39.372383 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:39.381086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-378c5493-6217-4407-99df-64d0bdba6b3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1722 microversion: 2.1 time: 0.156766 Sep 26 05:50:39.381686 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 329/648] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:39 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:40.230413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:40.230980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:40.239160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:40.239651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:40.240090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:40.240799 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:40.241292 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:40.241719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:40.375974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:40.387897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-80166f9e-a52f-4098-9c47-8c010c2a3205 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.163058 Sep 26 05:50:40.388645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 320/649] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:40 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:40.404112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:40.404690 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:40.411619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:40.412111 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:40.412542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:40.413281 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:40.413709 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:40.414137 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:40.552334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:40.561430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7d0eb936-3135-4a22-afdf-2d407b9a9888 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1722 microversion: 2.1 time: 0.161109 Sep 26 05:50:40.562344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 330/650] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:40 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:41.412561 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:41.413203 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:41.421803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:41.422599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:41.423270 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:41.424452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:41.425208 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:41.425646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:41.573178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:41.583589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1dd90c5f-acc0-49c8-9a2f-de790dd119dc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1678 microversion: 2.1 time: 0.174973 Sep 26 05:50:41.598358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 321/651] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:41 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:41.598572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:41.598572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:41.598572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:41.598572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:41.599349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:41.599349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:41.599349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:41.599349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:41.746557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:41.756194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e6d15b89-5339-469a-9025-f1b17540fcc5 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1728 microversion: 2.1 time: 0.174615 Sep 26 05:50:41.756777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 331/652] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:41 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:41.785108 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:41.785805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:41.795259 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:41.796025 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:41.796638 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:41.797701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:41.798157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:41.798711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:41.896419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7cd0810f-0e22-4ec7-94e0-8ad6b7ded996 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117333 Sep 26 05:50:41.897280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 322/653] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:50:41 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:50:42.608614 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:42.609386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:42.616625 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:42.617096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:42.617579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:42.618283 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:42.618740 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:42.619160 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:42.792762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:42.801539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e580496b-f4bd-40dc-a381-9ef25c2f7aa9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1655 microversion: 2.1 time: 0.197191 Sep 26 05:50:42.802145 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 332/654] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:42 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1655 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:42.835142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-912a4552-4441-449d-a999-18eb35ef0419 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:42.843658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-912a4552-4441-449d-a999-18eb35ef0419 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:42.844252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-912a4552-4441-449d-a999-18eb35ef0419 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:42.844682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-912a4552-4441-449d-a999-18eb35ef0419 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:42.869412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-912a4552-4441-449d-a999-18eb35ef0419 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Going to try to start instance {{(pid=127275) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 05:50:42.928638 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-912a4552-4441-449d-a999-18eb35ef0419 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action" status: 202 len: 0 microversion: 2.1 time: 0.100408 Sep 26 05:50:42.929596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 323/655] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:50:42 2022] POST /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:50:42.939491 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:42.940686 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:42.948926 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:42.949743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:42.950183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:42.951224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:42.953432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:42.954314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:43.185384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:43.201814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-aa4da0fd-8e84-4718-b6d1-d7b7ce8d4bb2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1664 microversion: 2.1 time: 0.265869 Sep 26 05:50:43.216335 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 333/656] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:42 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1664 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:50:43.318198 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-07c8674d-43fa-4681-ab73-91bece3ce252 req-885df50f-5aa2-41e3-8c67-f35c6df8bb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09331c3-4186-46a6-abeb-f3e5ef0ec10d", "tag": "438d048d-b815-4fa3-98df-918b47d1b86c"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:43.328356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-07c8674d-43fa-4681-ab73-91bece3ce252 req-885df50f-5aa2-41e3-8c67-f35c6df8bb35 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:43.328835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-07c8674d-43fa-4681-ab73-91bece3ce252 req-885df50f-5aa2-41e3-8c67-f35c6df8bb35 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:43.329296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-07c8674d-43fa-4681-ab73-91bece3ce252 req-885df50f-5aa2-41e3-8c67-f35c6df8bb35 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:43.341922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-07c8674d-43fa-4681-ab73-91bece3ce252 req-885df50f-5aa2-41e3-8c67-f35c6df8bb35 service nova] Creating event network-changed:438d048d-b815-4fa3-98df-918b47d1b86c for instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d on hv-cinder-83608 Sep 26 05:50:43.347456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-07c8674d-43fa-4681-ab73-91bece3ce252 req-885df50f-5aa2-41e3-8c67-f35c6df8bb35 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183933 Sep 26 05:50:43.348221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 324/657] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:50:44.232333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:44.233043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:44.239841 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:44.240291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:44.240725 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:44.241483 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:44.241933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:44.242398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:44.394619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:44.403910 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-69991633-2acb-4268-9f43-1e935ee179f6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1664 microversion: 2.1 time: 0.176204 Sep 26 05:50:44.404489 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 334/658] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:44 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:45.366490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-c368d802-86e4-4384-a25b-9c6aafd60779 req-524cf89e-e6ac-46f5-8247-de3bfc326046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09331c3-4186-46a6-abeb-f3e5ef0ec10d", "tag": "438d048d-b815-4fa3-98df-918b47d1b86c"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:45.371333 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=44 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:45.378161 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c368d802-86e4-4384-a25b-9c6aafd60779 req-524cf89e-e6ac-46f5-8247-de3bfc326046 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:45.378643 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c368d802-86e4-4384-a25b-9c6aafd60779 req-524cf89e-e6ac-46f5-8247-de3bfc326046 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:45.379051 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c368d802-86e4-4384-a25b-9c6aafd60779 req-524cf89e-e6ac-46f5-8247-de3bfc326046 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:45.392612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-c368d802-86e4-4384-a25b-9c6aafd60779 req-524cf89e-e6ac-46f5-8247-de3bfc326046 service nova] Creating event network-changed:438d048d-b815-4fa3-98df-918b47d1b86c for instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d on hv-cinder-83608 Sep 26 05:50:45.398085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-c368d802-86e4-4384-a25b-9c6aafd60779 req-524cf89e-e6ac-46f5-8247-de3bfc326046 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037041 Sep 26 05:50:45.398655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 325/659] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:50:45.428921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:45.429583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:45.436387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:45.436877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:45.437334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:45.438036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:45.438493 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:45.438921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:45.578754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:45.588032 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c9e4d74b-606e-4bf1-9f0c-241bf2a5ae77 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1668 microversion: 2.1 time: 0.163024 Sep 26 05:50:45.588725 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 335/660] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:45 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:55.914407 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:55.915067 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:55.920087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:50:55.922422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:55.930280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:55.930769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:55.931200 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:55.931897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:55.932380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:55.932746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:56.008905 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d5d2d66a-fb4d-403b-8248-9ee7627d458b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/action" status: 202 len: 0 microversion: 2.1 time: 0.095972 Sep 26 05:50:56.009587 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 326/661] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:50:55 2022] POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:50:56.020150 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:56.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:56.024024 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=45 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:56.024689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:56.030791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:56.031288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:56.031731 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:56.032722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:56.033199 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:56.033624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:56.194638 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:56.203903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cacdd95d-07ec-4c6a-b76c-82c9c760343f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1753 microversion: 2.1 time: 0.189321 Sep 26 05:50:56.204473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 336/662] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:56 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:50:57.230748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:57.231375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:57.240240 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:57.240925 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:57.241563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:57.242366 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:57.242995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:57.243566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:57.404791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:57.413658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-cfdd36df-de37-48a3-905f-a14ce38f330e tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.187264 Sep 26 05:50:57.414232 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 327/663] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:57 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:58.437609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:58.438250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:58.446387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:58.446882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:58.447393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:58.448496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:58.449083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:58.449675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:58.628323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:58.637593 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-62a0c39b-8414-489e-93c3-d88bd7637caf tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.203830 Sep 26 05:50:58.638378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 337/664] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:58 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:50:59.661668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:50:59.662588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:50:59.670196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:59.670665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:59.671099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:59.671819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:50:59.672265 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:50:59.672687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:50:59.834782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:50:59.843624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c120fbf1-46a6-4d3a-880b-f5185b78aba3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.186023 Sep 26 05:50:59.844188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 328/665] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:50:59 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:00.867647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:00.868247 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:00.877393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:00.878054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:00.878742 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:00.879589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:00.880043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:00.880583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:01.040394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:01.049529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3507cf6f-3b0b-492c-9d02-6230b9961a1c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.186148 Sep 26 05:51:01.050120 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 338/666] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:00 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:02.074355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:02.075228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:02.082085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:02.082578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:02.083007 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:02.083717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:02.084171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:02.084589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:02.248657 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:02.260413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-441cf2fa-9dbd-49e0-895f-9ff9b04807ed tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.190480 Sep 26 05:51:02.261023 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 329/667] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:02 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:03.284566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:03.285204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:03.292516 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:03.292995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:03.293448 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:03.294138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:03.294576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:03.294983 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:03.453319 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:03.462919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0dfdff8f-ac92-43f8-8053-0aeb2d0e170b tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.182182 Sep 26 05:51:03.463512 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 339/668] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:03 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:04.486972 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:04.487545 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:04.494817 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:04.495306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:04.495734 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:04.496435 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:04.496886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:04.497338 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:04.649619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:04.658643 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-af5027a6-0f01-4856-bac6-0356833db9e3 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.175652 Sep 26 05:51:04.659254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 330/669] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:04 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:05.682975 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:05.683666 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:05.691478 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:05.691968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:05.692401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:05.693103 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:05.693587 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:05.694003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:05.850453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:05.861012 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fb0fb831-77e3-4826-8824-5a2225ebe669 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.180184 Sep 26 05:51:05.861012 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 340/670] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:05 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:06.885379 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:06.886008 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:06.892890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:06.893400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:06.893828 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:06.894526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:06.894939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:06.895423 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:07.063704 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:07.073590 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-97215d07-0132-4802-b169-6836972359a7 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.192376 Sep 26 05:51:07.074275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 331/671] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:06 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:08.101884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:08.102520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:08.109688 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:08.110176 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:08.110608 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:08.111320 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:08.111768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:08.112191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:08.272790 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:08.281795 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-986ce93e-f804-41c6-9712-ac9cf842b999 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1758 microversion: 2.1 time: 0.184421 Sep 26 05:51:08.282503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 341/672] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:08 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:09.305898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:09.306506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:09.313394 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:09.313875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:09.314299 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:09.315113 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:09.315580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:09.316014 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:09.481572 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:09.491124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-10a64ba5-87d1-46fc-8def-1e5611d64569 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1761 microversion: 2.1 time: 0.189280 Sep 26 05:51:09.491620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 332/673] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:09 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1761 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:25.676814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:25.677590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:25.679711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=12 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:25.680353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=36 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:25.687355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:25.687848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:25.688284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:25.689021 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:25.689498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:25.690363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:25.723487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c26ad3ab-7b84-4cdc-ac66-fb8f84efc406 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments/6164fce8-dd68-4d37-b29b-cf1744d34c45" status: 200 len: 194 microversion: 2.20 time: 0.051485 Sep 26 05:51:25.724107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 342/674] 10.222.0.57 () {60 vars in 1454 bytes} [Mon Sep 26 05:51:25 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments/6164fce8-dd68-4d37-b29b-cf1744d34c45 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:51:25.810738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:25.811467 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:25.813604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=14 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:25.814267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:25.820431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:25.820928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:25.821402 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:25.822126 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:25.822582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:25.822999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:25.965899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lazy-loading 'services' on Instance uuid c1734960-6d94-4c7b-b6e4-0556d841388b {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:51:26.112854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-36b71879-6b58-4fda-ad10-8afbef301123 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments/6164fce8-dd68-4d37-b29b-cf1744d34c45" status: 202 len: 0 microversion: 2.20 time: 0.306614 Sep 26 05:51:26.113484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 333/675] 10.222.0.57 () {60 vars in 1457 bytes} [Mon Sep 26 05:51:25 2022] DELETE /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments/6164fce8-dd68-4d37-b29b-cf1744d34c45 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:51:26.124569 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:26.127331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:26.133903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:26.134395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:26.135032 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:26.136081 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:26.136518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:26.137114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:26.172544 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f4648704-0c26-463b-a90d-125152b97bad tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052075 Sep 26 05:51:26.173190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 343/676] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Sep 26 05:51:26 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:51:27.187084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:27.189836 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:27.196728 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:27.197248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:27.197689 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:27.198409 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:27.198867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:27.199291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:27.235995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a107fe99-ec27-4822-882b-30758d035fe4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052911 Sep 26 05:51:27.236518 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 334/677] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Sep 26 05:51:27 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:51:28.248744 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:28.251017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:28.258255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.258746 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.259160 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.259855 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.260299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.260712 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.269900 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:28.270522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:28.277326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.277832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.278245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.278954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.279381 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.279791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.295264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2f5f260c-a51c-4a80-8e4d-9d92536a9677 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050560 Sep 26 05:51:28.295838 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 344/678] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Sep 26 05:51:28 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:28.314874 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1bd821e6-d53d-47ed-a3de-aa1b9ab7f331 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6/ips" status: 200 len: 149 microversion: 2.1 time: 0.048897 Sep 26 05:51:28.315474 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 335/679] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:51:28 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:28.329008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf0e9365-68ac-4813-9a32-9b38f323ed9a"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:28.331542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:28.338167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.338650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.339076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.339789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.340250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.340670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.371072 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:28.371547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:28.377999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.378488 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.378929 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.379634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.380083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.380504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.408958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:51:28.450104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Invalid volume: volume cf0e9365-68ac-4813-9a32-9b38f323ed9a is already attached to instances: ea993d78-323c-4565-9a8e-db170bd7954a Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: POST /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6/os-volume_attachments HTTP/1.1 Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 74 Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:51:28.453449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {"volumeAttachment": {"volumeId": "cf0e9365-68ac-4813-9a32-9b38f323ed9a"}} Sep 26 05:51:28.456531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Invalid volume: volume cf0e9365-68ac-4813-9a32-9b38f323ed9a is already attached to instances: ea993d78-323c-4565-9a8e-db170bd7954a Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'server_id': '00537282-21fe-4a1e-ac28-4375d53cb8e6', 'body': {'volumeAttachment': {'volumeId': 'cf0e9365-68ac-4813-9a32-9b38f323ed9a'}}} Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf0e9365-68ac-4813-9a32-9b38f323ed9a is already attached to instances: ea993d78-323c-4565-9a8e-db170bd7954a Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:51:28.458185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf0e9365-68ac-4813-9a32-9b38f323ed9a is already attached to instances: ea993d78-323c-4565-9a8e-db170bd7954a Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:28.461472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf0e9365-68ac-4813-9a32-9b38f323ed9a is already attached to instances: ea993d78-323c-4565-9a8e-db170bd7954a Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 400 to user: Invalid volume: volume cf0e9365-68ac-4813-9a32-9b38f323ed9a is already attached to instances: ea993d78-323c-4565-9a8e-db170bd7954a {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-893dfa8a-a7ef-434b-ba8c-a26acbdd35f2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.130864 Sep 26 05:51:28.464676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 345/680] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:51:28 2022] POST /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6/os-volume_attachments => generated 174 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 05:51:28.468695 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:28.469223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:28.476654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.477352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.477952 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.478901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.479451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.480169 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.510239 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:51:28.514535 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2d7f56f1-e86d-4684-a7b6-21bd5c71a398 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 204 len: 0 microversion: 2.20 time: 0.145715 Sep 26 05:51:28.516368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 336/681] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Sep 26 05:51:28 2022] DELETE /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 26 05:51:28.525875 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:28.526625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:28.533495 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.533977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.534420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.535123 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.535577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.535983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.621585 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-497c00b2-2eb1-4c6f-9771-8dcbad1fe3cb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 204 len: 0 microversion: 2.1 time: 0.157828 Sep 26 05:51:28.622259 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 346/682] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:51:28 2022] DELETE /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:51:28.632310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:28.633255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:28.639763 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.640231 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.640655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.641399 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:28.641850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:28.642265 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:28.727922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:28.739777 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:28.742464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:28.744466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f036b028-4b01-4409-bdb6-42a737a53f5a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.223227 Sep 26 05:51:28.745262 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 337/683] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:28 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:28.816454 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:28.825965 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0385223f-2cc1-4e9f-b57d-c6958fda87cf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1680 microversion: 2.1 time: 0.198064 Sep 26 05:51:28.826576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 347/684] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:28 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:51:29.788104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:29.788794 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:29.795902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:29.796398 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:29.796822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:29.797539 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:29.797988 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:29.798772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:29.866845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:29.867901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:29.879557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:29.880377 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:29.881220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:29.882793 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:29.883386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:29.885725 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:29.965628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:29.974638 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:29.976517 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:29.977331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9a386873-9f83-4b44-8129-7e4b040850ab tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.193637 Sep 26 05:51:29.977921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 338/685] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:29 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:30.029499 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:30.037682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a3f716e1-c740-436a-889d-cf2fbf7a882c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1680 microversion: 2.1 time: 0.176188 Sep 26 05:51:30.038275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 348/686] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:29 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:31.003795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:31.004393 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:31.007063 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 05:51:31.007242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 05:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b (ip 10.222.0.57) !!! Sep 26 05:51:31.009679 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 05:51:31.009854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 05:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b (ip 10.222.0.57) !!! Sep 26 05:51:31.019619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:31.020099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:31.020533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:31.021281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:31.021746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:31.022293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:31.061545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:31.062195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:31.069177 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:31.069788 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:31.070292 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:31.070908 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:31.071348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:31.071756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:31.176919 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:31.188630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:31.190123 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:31.191302 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-438f7b5e-b5e1-4a91-842c-96f34ca48745 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.191759 Sep 26 05:51:31.192196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 339/687] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:30 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:31.222026 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:31.230366 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-22afca63-db9b-46cc-a841-1d278fecc738 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1680 microversion: 2.1 time: 0.172796 Sep 26 05:51:31.230932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 349/688] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:31 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:51:32.231564 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:32.232269 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:32.244473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:32.244473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:32.244473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:32.244473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:32.244846 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:32.244846 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:32.254926 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:32.256081 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:32.264094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 05:51:32.264375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 05:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 (ip 10.222.0.57) !!! Sep 26 05:51:32.267355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:32.267844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:32.268261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:32.269191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:32.269650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:32.270095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:32.526866 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:32.535273 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:32.539361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:32.541698 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:32.543364 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-50e7302d-787e-4fcf-bdb9-6ec2af43053c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1724 microversion: 2.20 time: 0.315941 Sep 26 05:51:32.544305 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 340/689] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:32 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:32.554310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c782901e-7d0e-4cee-be01-d9f16f63a003 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1680 microversion: 2.1 time: 0.302051 Sep 26 05:51:32.569194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 350/690] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:32 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1680 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:33.256408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-675281dc-5a65-456e-accb-18a8442351f8 req-d2abc98f-45a6-4a12-abb1-9bb1b31554ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1734960-6d94-4c7b-b6e4-0556d841388b", "name": "network-vif-deleted", "tag": "13bc2cea-45a7-43cc-8730-0f8356ec20ea"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:33.268924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-675281dc-5a65-456e-accb-18a8442351f8 req-d2abc98f-45a6-4a12-abb1-9bb1b31554ab service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:33.270656 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-675281dc-5a65-456e-accb-18a8442351f8 req-d2abc98f-45a6-4a12-abb1-9bb1b31554ab service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:33.271195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-675281dc-5a65-456e-accb-18a8442351f8 req-d2abc98f-45a6-4a12-abb1-9bb1b31554ab service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:33.283822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-675281dc-5a65-456e-accb-18a8442351f8 req-d2abc98f-45a6-4a12-abb1-9bb1b31554ab service nova] Creating event network-vif-deleted:13bc2cea-45a7-43cc-8730-0f8356ec20ea for instance c1734960-6d94-4c7b-b6e4-0556d841388b on hv-cinder-83608 Sep 26 05:51:33.290563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-675281dc-5a65-456e-accb-18a8442351f8 req-d2abc98f-45a6-4a12-abb1-9bb1b31554ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038106 Sep 26 05:51:33.291688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 341/691] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:33.570929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:33.571542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:33.578791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:33.579843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:33.580642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:33.581604 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:33.582271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:33.582839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:33.597236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:33.597933 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:33.614085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:33.614585 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:33.615022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:33.618758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:33.619469 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:33.619736 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:33.620221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:33.620836 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lazy-loading 'fault' on Instance uuid c1734960-6d94-4c7b-b6e4-0556d841388b {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:51:33.623082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:33.623594 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:33.723168 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:33.731761 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:33.766936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:33.768289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:33.770898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6b6c9a80-78f3-436d-9b30-c08eaa0fcf95 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1613 microversion: 2.1 time: 0.178115 Sep 26 05:51:33.773376 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 342/692] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:33 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1613 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:51:33.776260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-37b2f44c-6e06-440c-acae-041f2a640012 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 200 len: 1372 microversion: 2.20 time: 0.204044 Sep 26 05:51:33.777020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 351/693] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:33 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:33.898439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-605d86d8-306a-42ef-94e4-7f8d6a538543 req-5ddb10e4-fb78-448c-a788-bcf234827e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00537282-21fe-4a1e-ac28-4375d53cb8e6", "name": "network-vif-deleted", "tag": "be74a780-bfc1-43dd-84cf-1d45dffcbc7f"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:33.909087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-605d86d8-306a-42ef-94e4-7f8d6a538543 req-5ddb10e4-fb78-448c-a788-bcf234827e34 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:33.909928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-605d86d8-306a-42ef-94e4-7f8d6a538543 req-5ddb10e4-fb78-448c-a788-bcf234827e34 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:33.910358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-605d86d8-306a-42ef-94e4-7f8d6a538543 req-5ddb10e4-fb78-448c-a788-bcf234827e34 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:33.923002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-605d86d8-306a-42ef-94e4-7f8d6a538543 req-5ddb10e4-fb78-448c-a788-bcf234827e34 service nova] Creating event network-vif-deleted:be74a780-bfc1-43dd-84cf-1d45dffcbc7f for instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 on hv-cinder-83608 Sep 26 05:51:33.928600 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-605d86d8-306a-42ef-94e4-7f8d6a538543 req-5ddb10e4-fb78-448c-a788-bcf234827e34 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112003 Sep 26 05:51:33.929886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 343/694] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:34.798885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:34.800208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:34.807572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:34.808980 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:34.809667 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:34.810919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:34.811717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:34.812418 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:34.816239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:34.824278 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:34.848634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:34.852139 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:34.853645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:34.854908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:34.857194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:34.858149 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:34.883196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:34.883968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:34.884568 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:34.885254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lazy-loading 'fault' on Instance uuid 00537282-21fe-4a1e-ac28-4375d53cb8e6 {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:51:34.916104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] HTTP exception thrown: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Request method failure captured: Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b HTTP/1.1 Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5Oj7JQcjiU4GXqLuHLbTlC8ro5Xc8Jtn9tP-evEPEwQ9mA6YC2TEppR9cM_rIglE5AOuN6V8rQ6I9KWi1hKczCZfGat7uwIgTdPxQA8sSok9BKIBvEld32FUkjxfEc0a8XoVhIdUDHkOaBuM7qlkt3ALnT4cSZN_iSb3seSlm3-o Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:51:34.922908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25d426f519e8498e80c6c85158bd9042", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 9d9e9c8e26774e739695b7e4d42eeafd Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:51:34.925891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'c1734960-6d94-4c7b-b6e4-0556d841388b'} Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:51:34.927705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:51:34.934389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:34.942963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:34.942963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3d1cd7c4-2b10-4569-9e80-09e345f64753 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 200 len: 1331 microversion: 2.1 time: 0.147602 Sep 26 05:51:34.950485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 352/695] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:34 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:34.951078 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Returning 404 to user: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:51:34.953042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0456f75f-723a-4660-9dcb-bdf330f59ab9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 404 len: 111 microversion: 2.20 time: 0.153500 Sep 26 05:51:34.960746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 344/696] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:34 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:51:34.970636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-538d293c-ed94-4aa3-bc9e-e052d0e94a7a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '.version_select at 0x7f1e5e5855e0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:35.043076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-538d293c-ed94-4aa3-bc9e-e052d0e94a7a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801855020" status: 204 len: 0 microversion: 2.20 time: 0.079723 Sep 26 05:51:35.043692 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 353/697] 10.222.0.57 () {60 vars in 1262 bytes} [Mon Sep 26 05:51:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1801855020 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 05:51:35.970057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:35.971041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:35.980050 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:35.980536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:35.981276 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:35.981760 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:35.982179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:35.982754 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:35.996445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 HTTP/1.1 Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:51:35.998057 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:51:36.000752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '00537282-21fe-4a1e-ac28-4375d53cb8e6'} Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:51:36.002086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:51:36.004622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:36.011286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:51:36.011286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c4a9a2c8-0e7d-4376-937a-d718b76cbb1e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 404 len: 111 microversion: 2.1 time: 0.034708 Sep 26 05:51:36.011286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 345/698] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:35 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:51:36.014358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3424815f-d59f-4ad2-8d48-f8679639601a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '.version_select at 0x7f1e5e6b4a60>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:36.015284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-81dc8876-317c-49fc-8eff-f12cca06ca9f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'create', calling method: .version_select at 0x7f1e5e429670>, body: {"keypair": {"name": "tempest-keypair-875129080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFctZV9uTC68T3vfm+bhOso7DEXI5lLY9PYSKWWQpv+JkWvNX/H0scf2lgZvNoQhml6SIq8yftw1CWCId7/jc1s8s2dz+sFXG8cw2chnd8vAoVq+vGhVd8rXRTj+Wx9vMQ=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:36.032485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-81dc8876-317c-49fc-8eff-f12cca06ca9f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for project 25d426f519e8498e80c6c85158bd9042. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:51:36.036884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-81dc8876-317c-49fc-8eff-f12cca06ca9f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for user 9d9e9c8e26774e739695b7e4d42eeafd and project 25d426f519e8498e80c6c85158bd9042. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:51:36.038570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3424815f-d59f-4ad2-8d48-f8679639601a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-621968988" status: 202 len: 0 microversion: 2.1 time: 0.028051 Sep 26 05:51:36.039153 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 346/699] 10.222.0.57 () {58 vars in 1218 bytes} [Mon Sep 26 05:51:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-621968988 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:51:36.060695 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-81dc8876-317c-49fc-8eff-f12cca06ca9f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053381 Sep 26 05:51:36.061357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 354/700] 10.222.0.57 () {62 vars in 1200 bytes} [Mon Sep 26 05:51:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 05:51:36.874552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:36.874967 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:36.882504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:36.883337 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:36.883779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:36.884501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:36.884965 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:36.885418 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:36.976729 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lazy-loading 'services' on Instance uuid ea993d78-323c-4565-9a8e-db170bd7954a {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:51:37.103823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-004aed1a-a56f-4dba-8200-89db32d21545 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments/cf0e9365-68ac-4813-9a32-9b38f323ed9a" status: 202 len: 0 microversion: 2.1 time: 0.233496 Sep 26 05:51:37.106272 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 347/701] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:51:36 2022] DELETE /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments/cf0e9365-68ac-4813-9a32-9b38f323ed9a => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:51:37.118718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:37.122395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:37.131856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:37.132467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:37.133331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:37.139051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:37.140009 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:37.140778 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:37.202350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4cfd85cd-8377-4389-82f6-833f772d1e70 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092049 Sep 26 05:51:37.203756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 355/702] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:51:37 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:51:37.615995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1978338416", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "439e1f14-830a-49c8-95fe-a76bc50181b7"}], "security_groups": [{"name": "tempest-securitygroup--291543473"}], "key_name": "tempest-keypair-875129080", "user_data": "}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:37.740408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] validate_networks() for [('439e1f14-830a-49c8-95fe-a76bc50181b7', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:51:38.219227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:38.222552 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:38.229271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.229763 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.230218 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.231123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.231775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.232199 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.242943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:51:38.244175 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:51:38.244665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:51:38.245108 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:51:38.245548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:51:38.255489 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.255971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.256415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.257241 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.257699 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.258114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.267689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1d8da5b6-328d-4927-8630-efe0cff3d15e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052448 Sep 26 05:51:38.268290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 356/703] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:51:38 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:51:38.278154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for project 25d426f519e8498e80c6c85158bd9042. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:51:38.282482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Getting quotas for user 9d9e9c8e26774e739695b7e4d42eeafd and project 25d426f519e8498e80c6c85158bd9042. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:51:38.295224 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:51:38.297714 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:51:38.363017 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dbe9c00b-73f4-4f28-9405-abcb9781b0cc tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.751722 Sep 26 05:51:38.363914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 348/704] 10.222.0.57 () {62 vars in 1188 bytes} [Mon Sep 26 05:51:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 05:51:38.368369 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:38.368953 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:38.374968 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4c94ada1-12bc-42c5-b5b9-9eabcf097973 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:38.375574 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4c94ada1-12bc-42c5-b5b9-9eabcf097973 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:38.375711 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.376214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.376851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.377665 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.378193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.378681 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.422439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:51:38.443482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4c94ada1-12bc-42c5-b5b9-9eabcf097973 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:38.449229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:38.452613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4c94ada1-12bc-42c5-b5b9-9eabcf097973 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:38.454114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4c94ada1-12bc-42c5-b5b9-9eabcf097973 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:38.455248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4c94ada1-12bc-42c5-b5b9-9eabcf097973 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1281 microversion: 2.20 time: 0.084148 Sep 26 05:51:38.455861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 349/705] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:38 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:51:38.549095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5075528b-116a-4a52-b66a-58d323f26fa3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 204 len: 0 microversion: 2.1 time: 0.186826 Sep 26 05:51:38.549907 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 357/706] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:51:38 2022] DELETE /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:51:38.558403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:38.559065 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:38.565504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.565995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.566724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.567480 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:38.567937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:38.568343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:38.707982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:38.717556 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c877513f-c726-4811-9717-b1ae9d20899e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1682 microversion: 2.1 time: 0.162667 Sep 26 05:51:38.718247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 350/707] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:38 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:39.501018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:39.501767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:39.509074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:39.509718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:39.510156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:39.510884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:39.511337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:39.511753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:39.583550 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:39.595529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:39.597064 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:39.598267 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ed73fe2e-fe59-492b-8ff5-2fe8a6492207 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1333 microversion: 2.20 time: 0.102314 Sep 26 05:51:39.598839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 358/708] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:39 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:39.753886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:39.754523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:39.761861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:39.762380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:39.762810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:39.763540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:39.763999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:39.764420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:39.906197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:39.914454 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5178c8ac-42f1-4b95-83cb-083f005eab00 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1682 microversion: 2.1 time: 0.164456 Sep 26 05:51:39.915060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 351/709] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:39 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:51:40.624257 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:40.624843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:40.632072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:40.632611 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:40.633038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:40.633787 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:40.634240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:40.634655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:40.735207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:40.753665 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:40.757686 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:40.760299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e51f2527-4a1c-49ff-9f16-104b9359d699 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1339 microversion: 2.20 time: 0.139928 Sep 26 05:51:40.763043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 359/710] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:40 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1339 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:40.941491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:40.943386 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:40.954981 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:40.955833 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:40.956840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:40.958088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:40.958686 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:40.959260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:40.964617 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:41.073496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-145246a7-8db9-4bde-b913-8114f9a0dd54 req-cd5e744b-0e68-4967-b14a-cea2f3377a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea993d78-323c-4565-9a8e-db170bd7954a", "name": "network-vif-deleted", "tag": "6f3cd267-47c3-4bd9-9283-70669f0b6b2c"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:41.087566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-145246a7-8db9-4bde-b913-8114f9a0dd54 req-cd5e744b-0e68-4967-b14a-cea2f3377a3c service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:41.088473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-145246a7-8db9-4bde-b913-8114f9a0dd54 req-cd5e744b-0e68-4967-b14a-cea2f3377a3c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:41.089450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-145246a7-8db9-4bde-b913-8114f9a0dd54 req-cd5e744b-0e68-4967-b14a-cea2f3377a3c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:41.106134 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-145246a7-8db9-4bde-b913-8114f9a0dd54 req-cd5e744b-0e68-4967-b14a-cea2f3377a3c service nova] Creating event network-vif-deleted:6f3cd267-47c3-4bd9-9283-70669f0b6b2c for instance ea993d78-323c-4565-9a8e-db170bd7954a on hv-cinder-83608 Sep 26 05:51:41.115517 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-145246a7-8db9-4bde-b913-8114f9a0dd54 req-cd5e744b-0e68-4967-b14a-cea2f3377a3c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042585 Sep 26 05:51:41.120642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 360/711] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:51:41.154451 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:41.180692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c6500698-461b-4878-b6ba-ed192e2d0f59 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 200 len: 1614 microversion: 2.1 time: 0.245860 Sep 26 05:51:41.206521 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 352/712] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:40 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 1614 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:41.788228 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:41.789063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:41.797606 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:41.798382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:41.798985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:41.799733 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:41.800189 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:41.800613 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:41.973965 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:41.996156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:41.998925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:42.000769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a442aa1a-f11f-49c5-a14e-fa431ea182b1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.216767 Sep 26 05:51:42.002000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 361/713] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:41 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:42.216985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:42.218267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:42.226692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:42.227192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:42.227670 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:42.228580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:42.229453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:42.229909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:42.251549 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a HTTP/1.1 Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:51:42.253349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:51:42.255868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'ea993d78-323c-4565-9a8e-db170bd7954a'} Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:51:42.257351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:51:42.259610 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:51:42.262445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:51:42.262445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-34109443-34f2-46c7-ba60-c38164d7f0e6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 404 len: 111 microversion: 2.1 time: 0.042366 Sep 26 05:51:42.262445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 353/714] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:42 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:51:42.271242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-802abab2-72cf-4090-a20a-9f5dd8cc5971 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '.version_select at 0x7f1e5e43c9d0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:42.294269 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-a48294da-ea06-482c-8b0f-275f42e67a5a req-921d7c60-014b-4b3e-937d-74c4ae81d71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8953bd1b-2a0e-4f90-8177-08638164cf69", "tag": "eab744db-21fb-4b22-8514-b8bf28f598a7"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:42.311391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a48294da-ea06-482c-8b0f-275f42e67a5a req-921d7c60-014b-4b3e-937d-74c4ae81d71f service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:42.312195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a48294da-ea06-482c-8b0f-275f42e67a5a req-921d7c60-014b-4b3e-937d-74c4ae81d71f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:42.313005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a48294da-ea06-482c-8b0f-275f42e67a5a req-921d7c60-014b-4b3e-937d-74c4ae81d71f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:42.314394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-802abab2-72cf-4090-a20a-9f5dd8cc5971 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532414122" status: 202 len: 0 microversion: 2.1 time: 0.049257 Sep 26 05:51:42.315739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 362/715] 10.222.0.57 () {58 vars in 1221 bytes} [Mon Sep 26 05:51:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1532414122 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:51:42.373491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-a48294da-ea06-482c-8b0f-275f42e67a5a req-921d7c60-014b-4b3e-937d-74c4ae81d71f service nova] Creating event network-changed:eab744db-21fb-4b22-8514-b8bf28f598a7 for instance 8953bd1b-2a0e-4f90-8177-08638164cf69 on hv-cinder-83608 Sep 26 05:51:42.384717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-a48294da-ea06-482c-8b0f-275f42e67a5a req-921d7c60-014b-4b3e-937d-74c4ae81d71f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097959 Sep 26 05:51:42.386629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 354/716] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:43.031241 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:43.032039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:43.038928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:43.039442 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:43.039866 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:43.040556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:43.040996 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:43.041645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:43.093494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-698d6a00-5ac4-48fa-b93a-6c2adcef3a66 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: .version_select at 0x7f1e5e330ca0>, body: {"keypair": {"name": "tempest-keypair-1230459918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOXVh5BLx5iDKooGqohUVDKqX3sTidqbQkHtaN+OrV+8InBGfJwUCtg+cLHHGjYF+1GzP5e52ewht3QrPyIf4QrNt03W+zoyq3YzAs8Ru2x5KB/kEoPKTQ1ZhaBOHKadw=="}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:43.108761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-698d6a00-5ac4-48fa-b93a-6c2adcef3a66 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:51:43.112722 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-698d6a00-5ac4-48fa-b93a-6c2adcef3a66 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:51:43.139524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-698d6a00-5ac4-48fa-b93a-6c2adcef3a66 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052547 Sep 26 05:51:43.140259 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 355/717] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:51:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:43.187313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:43.202163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:43.204980 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:43.207121 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-278decd0-a78b-4efc-a2a7-c2166d9ba926 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.180076 Sep 26 05:51:43.208124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 363/718] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:43 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:44.233727 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:44.234814 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:44.242560 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:44.243075 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:44.243492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:44.244213 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:44.244720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:44.245174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:44.392903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:44.401739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:44.403178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:44.404293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-08790cb0-cc5b-4276-858c-2ed817e334b0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.174912 Sep 26 05:51:44.404867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 356/719] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:44 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:44.520515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-925543694", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f147de2c-29b4-4f2b-a870-47c60a471f05"}], "security_groups": [{"name": "tempest-securitygroup--1110533989"}], "key_name": "tempest-keypair-1230459918", "user_data": "}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:44.644365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] validate_networks() for [('f147de2c-29b4-4f2b-a870-47c60a471f05', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:51:45.054936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:51:45.055658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:51:45.056453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:51:45.057116 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:51:45.057824 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:51:45.072147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:45.072924 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:45.073644 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:45.074803 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:45.075534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:45.076240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:45.096482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:51:45.100795 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:51:45.113417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:51:45.115743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:51:45.166588 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f08b526d-dc89-4ace-ba69-bd6fc6f8e19e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650107 Sep 26 05:51:45.167537 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 364/720] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:51:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:51:45.179522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c9bf1435-e293-4232-9164-22068312df26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:45.180138 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c9bf1435-e293-4232-9164-22068312df26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:45.256522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c9bf1435-e293-4232-9164-22068312df26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:45.263757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c9bf1435-e293-4232-9164-22068312df26 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1241 microversion: 2.1 time: 0.088145 Sep 26 05:51:45.264348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 357/721] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:45 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:45.431375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:45.431999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:45.439036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:45.439541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:45.440152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:45.440736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:45.441229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:45.441658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:45.590120 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:45.599596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:45.601072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:45.602255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-836bc1c1-e254-4864-abfa-e13fe8972855 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.175430 Sep 26 05:51:45.602849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 365/722] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:45 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:51:46.287633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:46.288701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:46.296089 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:46.297327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:46.297841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:46.298769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:46.299298 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:46.299819 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:46.382312 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:46.393185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e9e24cdd-6238-4e29-93fa-aa3383e93d54 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1293 microversion: 2.1 time: 0.109714 Sep 26 05:51:46.393718 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 358/723] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:46 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:46.628152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:46.628756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:46.635689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:46.636179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:46.636609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:46.637350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:46.637805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:46.638224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:46.788703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:46.797843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:46.799663 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:46.800784 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-316552a3-9bff-4ed3-b6c4-2e7433119709 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.176706 Sep 26 05:51:46.813162 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 366/724] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:46 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:47.418673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:47.419375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:47.426247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:47.426724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:47.427154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:47.427849 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:47.428335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:47.428779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:47.507386 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:47.516207 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8ec0a05e-557c-4dc3-b397-b24b89ec718f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1299 microversion: 2.1 time: 0.101697 Sep 26 05:51:47.516792 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 359/725] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:47 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:47.826530 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:47.827875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:47.837599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:47.837599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:47.837599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:47.837599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:47.838296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:47.838296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:47.989036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:47.998012 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:47.999794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:48.001591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d0975e9f-be81-413f-9d48-8da71f40a29c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.179216 Sep 26 05:51:48.002299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 367/726] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:47 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:48.542506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:48.543113 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:48.545408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:48.551664 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:48.552142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:48.552733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:48.553461 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:48.554043 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:48.554462 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:48.752917 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:48.762004 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9887d0e5-0dff-49bb-a8fa-244863799ead tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.223689 Sep 26 05:51:48.762613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 360/727] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:48 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:48.903255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-633b2bdb-2574-49b3-98f1-38ee803af8e2 req-3ca31df1-3c4c-4acb-9928-75e78a342801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430ecb3c-5a38-48a6-8054-84029ce9705e", "tag": "1a37892d-e555-40b3-af75-2110c6c4fd34"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:48.914923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:48.921821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-633b2bdb-2574-49b3-98f1-38ee803af8e2 req-3ca31df1-3c4c-4acb-9928-75e78a342801 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:48.922358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-633b2bdb-2574-49b3-98f1-38ee803af8e2 req-3ca31df1-3c4c-4acb-9928-75e78a342801 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:48.923164 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-633b2bdb-2574-49b3-98f1-38ee803af8e2 req-3ca31df1-3c4c-4acb-9928-75e78a342801 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:48.941609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-633b2bdb-2574-49b3-98f1-38ee803af8e2 req-3ca31df1-3c4c-4acb-9928-75e78a342801 service nova] Creating event network-changed:1a37892d-e555-40b3-af75-2110c6c4fd34 for instance 430ecb3c-5a38-48a6-8054-84029ce9705e on hv-cinder-83608 Sep 26 05:51:48.944258 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-633b2bdb-2574-49b3-98f1-38ee803af8e2 req-3ca31df1-3c4c-4acb-9928-75e78a342801 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052421 Sep 26 05:51:48.944481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 368/728] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:49.028203 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:49.028843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:49.035640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:49.036129 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:49.036916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:49.037958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:49.038629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:49.039052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:49.254759 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:49.264077 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:49.265536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:49.266631 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-95207b6c-479d-43b1-83f5-5df7f2bfd5c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.243663 Sep 26 05:51:49.267183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 361/729] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:49 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:49.786900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:49.787503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:49.795732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:49.796225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:49.796655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:49.797371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:49.797839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:49.798244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:49.950300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:49.958794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a62e3fd2-8960-444b-8768-30d915a97c5b tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.176265 Sep 26 05:51:49.959379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 369/730] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:49 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:50.292333 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:50.293253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:50.301261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:50.302111 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:50.302556 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:50.303630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:50.304005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:50.304582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:50.451024 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-272fd4d3-308f-4d2f-ae80-f1d4e7700881 req-f88a7836-acfe-4fb8-99b6-33b90ba14650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8953bd1b-2a0e-4f90-8177-08638164cf69", "name": "network-vif-plugged", "status": "completed", "tag": "eab744db-21fb-4b22-8514-b8bf28f598a7"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:50.469273 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-272fd4d3-308f-4d2f-ae80-f1d4e7700881 req-f88a7836-acfe-4fb8-99b6-33b90ba14650 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:50.470571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-272fd4d3-308f-4d2f-ae80-f1d4e7700881 req-f88a7836-acfe-4fb8-99b6-33b90ba14650 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:50.471326 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-272fd4d3-308f-4d2f-ae80-f1d4e7700881 req-f88a7836-acfe-4fb8-99b6-33b90ba14650 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:50.487915 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-272fd4d3-308f-4d2f-ae80-f1d4e7700881 req-f88a7836-acfe-4fb8-99b6-33b90ba14650 service nova] Creating event network-vif-plugged:eab744db-21fb-4b22-8514-b8bf28f598a7 for instance 8953bd1b-2a0e-4f90-8177-08638164cf69 on hv-cinder-83608 Sep 26 05:51:50.493939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-272fd4d3-308f-4d2f-ae80-f1d4e7700881 req-f88a7836-acfe-4fb8-99b6-33b90ba14650 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143337 Sep 26 05:51:50.494560 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 370/731] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:51:50.500206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:50.509651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:50.511128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:50.512262 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d2b7e278-462e-49ec-bc5a-9386dda1f738 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.224123 Sep 26 05:51:50.512842 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 362/732] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:50 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:50.985465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:50.986271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:50.992903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:50.993406 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:50.993835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:50.994524 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:50.994972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:50.995387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:51.136648 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:51.144844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-42105e9d-7ac2-4248-be75-d44d99476578 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.164718 Sep 26 05:51:51.145462 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 371/733] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:50 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:51.541282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:51.541924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:51.546453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:51.552204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:51.552597 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:51.553123 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:51.554180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:51.554872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:51.555293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:51.699440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:51.711310 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:51.713378 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:51.714782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-cbd4c5ae-4de2-4f19-a180-0e14aed4bd20 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.179806 Sep 26 05:51:51.715444 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 363/734] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:51 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:52.168141 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:52.168726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:52.175737 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:52.176218 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:52.176642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:52.177382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:52.177845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:52.178263 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:52.317452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:52.325946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-63bb9599-ea4f-457b-92d7-601bd739a7fd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.161733 Sep 26 05:51:52.326623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 372/735] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:52 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:52.739772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:52.740367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:52.747435 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:52.747903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:52.748321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:52.748993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:52.749464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:52.749876 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:52.885559 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:52.894264 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:52.895701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:52.896822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-22057c30-f08b-456f-bb3c-c6bdabd9bcf5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.161043 Sep 26 05:51:52.897403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 364/736] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:52 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:53.349597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:53.350288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:53.357328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:53.357813 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:53.358237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:53.358920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:53.359370 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:53.359786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:53.504889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:53.513475 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-84e25516-d18a-43f6-9af0-feaa1e1feae4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.167608 Sep 26 05:51:53.514104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 373/737] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:53 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:53.924418 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:53.925028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:53.932955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:53.933477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:53.933906 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:53.934596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:53.935044 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:53.935458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:54.148588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:54.157469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:54.158970 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:54.160455 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3cc93a31-3747-4c1c-b828-6dc08297e0e3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1406 microversion: 2.20 time: 0.240389 Sep 26 05:51:54.160935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 365/738] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:53 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:54.393230 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-f4a039d6-3112-44cc-b9e5-d051d4d856e0 req-ff2008b1-0fc2-41dc-9152-bdea30056147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430ecb3c-5a38-48a6-8054-84029ce9705e", "name": "network-vif-plugged", "status": "completed", "tag": "1a37892d-e555-40b3-af75-2110c6c4fd34"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:54.403562 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-f4a039d6-3112-44cc-b9e5-d051d4d856e0 req-ff2008b1-0fc2-41dc-9152-bdea30056147 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:54.404041 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-f4a039d6-3112-44cc-b9e5-d051d4d856e0 req-ff2008b1-0fc2-41dc-9152-bdea30056147 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:54.404456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-f4a039d6-3112-44cc-b9e5-d051d4d856e0 req-ff2008b1-0fc2-41dc-9152-bdea30056147 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:54.416400 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-f4a039d6-3112-44cc-b9e5-d051d4d856e0 req-ff2008b1-0fc2-41dc-9152-bdea30056147 service nova] Creating event network-vif-plugged:1a37892d-e555-40b3-af75-2110c6c4fd34 for instance 430ecb3c-5a38-48a6-8054-84029ce9705e on hv-cinder-83608 Sep 26 05:51:54.421439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-f4a039d6-3112-44cc-b9e5-d051d4d856e0 req-ff2008b1-0fc2-41dc-9152-bdea30056147 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Sep 26 05:51:54.422023 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 374/739] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:54.539430 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:54.540339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:54.549620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:54.550331 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:54.550878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:54.551838 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:54.552295 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:54.552803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:54.708721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:54.717633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2136cee6-9fcd-4332-a5d6-ac905fe7dccf tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.183860 Sep 26 05:51:54.718206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 366/740] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:54 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:55.183151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:55.183871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=10 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:55.188122 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:55.188822 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:55.198736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:55.199223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:55.199658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:55.200353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:55.200806 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:55.201252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:55.611517 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:55.620636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:55.622112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:55.623292 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0a8f64a2-6cbd-468d-ac11-bcab5c348062 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1598 microversion: 2.20 time: 0.441283 Sep 26 05:51:55.623851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 375/741] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:51:55 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1598 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:51:55.647868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:55.648503 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:55.650728 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=14 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:55.656028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:55.656513 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:55.656927 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:55.657645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:55.658093 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:55.658506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:55.738012 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f6812f83-29f0-4386-b17f-d2110c3e00e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094005 Sep 26 05:51:55.738603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 367/742] 10.222.0.57 () {60 vars in 1316 bytes} [Mon Sep 26 05:51:55 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:51:55.741166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:55.741866 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:55.748454 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:55.748951 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:55.749410 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:55.750115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:55.750584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:55.751000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:56.029185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:56.038852 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5f8684cc-fe1c-45a9-b512-184571e31182 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.301775 Sep 26 05:51:56.039387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 376/743] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:55 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:51:56.813178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-c9339125-854c-4d70-9b92-a5c146d82417 req-96b7ca0d-0063-4757-ae4c-4292eb2f96bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8953bd1b-2a0e-4f90-8177-08638164cf69", "tag": "eab744db-21fb-4b22-8514-b8bf28f598a7"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:56.824951 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c9339125-854c-4d70-9b92-a5c146d82417 req-96b7ca0d-0063-4757-ae4c-4292eb2f96bb service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:56.825561 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c9339125-854c-4d70-9b92-a5c146d82417 req-96b7ca0d-0063-4757-ae4c-4292eb2f96bb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:56.826151 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c9339125-854c-4d70-9b92-a5c146d82417 req-96b7ca0d-0063-4757-ae4c-4292eb2f96bb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:56.839779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-c9339125-854c-4d70-9b92-a5c146d82417 req-96b7ca0d-0063-4757-ae4c-4292eb2f96bb service nova] Creating event network-changed:eab744db-21fb-4b22-8514-b8bf28f598a7 for instance 8953bd1b-2a0e-4f90-8177-08638164cf69 on hv-cinder-83608 Sep 26 05:51:56.845579 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-c9339125-854c-4d70-9b92-a5c146d82417 req-96b7ca0d-0063-4757-ae4c-4292eb2f96bb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037459 Sep 26 05:51:56.846396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 368/744] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:57.078583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:57.086928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:57.104343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:57.104985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:57.105545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:57.106600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:57.107305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:57.107928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:57.146597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:57.284151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:57.292650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-69f45968-deb3-4ca6-82cc-70ae9e0dedc5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1367 microversion: 2.1 time: 0.232656 Sep 26 05:51:57.293288 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 377/745] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:57 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:58.319493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:58.320749 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:58.333620 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:58.334458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:58.335564 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:58.336854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:58.337746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:58.338576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:58.493528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:51:58.502242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-02427a0f-d805-4790-86e1-f268f09674c6 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1556 microversion: 2.1 time: 0.189652 Sep 26 05:51:58.502811 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 369/746] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:51:58 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1556 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:51:58.525274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:58.525897 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:58.532558 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:58.533030 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:58.533474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:58.534155 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:58.534603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:58.535001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:58.617589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-168fcd34-139e-4b6d-bd9c-53ce44207195 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096045 Sep 26 05:51:58.618264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 378/747] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:51:58 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:59.248562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:59.249062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:59.256879 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:59.257630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:59.258068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:59.258820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:59.259255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:59.259674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:59.383255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lazy-loading 'services' on Instance uuid a09331c3-4186-46a6-abeb-f3e5ef0ec10d {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:51:59.482650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9d870133-df04-42dd-b614-54ef1405c630 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments/8fcda20c-9df8-456d-8402-a9372f393c19" status: 202 len: 0 microversion: 2.1 time: 0.238066 Sep 26 05:51:59.483751 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 370/748] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:51:59 2022] DELETE /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments/8fcda20c-9df8-456d-8402-a9372f393c19 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:51:59.499125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:51:59.503193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:51:59.514133 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:59.514989 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:59.515785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:59.517091 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:59.517969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:59.518714 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:59.571496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-52273dbf-ef6c-48cf-9e92-42b6ca7db35d tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081257 Sep 26 05:51:59.576871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 379/749] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:51:59 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:51:59.668644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-0a2212a2-d6c2-463a-8261-402eb922120e req-11bcb8bd-8f95-4aba-8ece-1ab704de365b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430ecb3c-5a38-48a6-8054-84029ce9705e", "tag": "1a37892d-e555-40b3-af75-2110c6c4fd34"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:51:59.678787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-0a2212a2-d6c2-463a-8261-402eb922120e req-11bcb8bd-8f95-4aba-8ece-1ab704de365b service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:51:59.679613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-0a2212a2-d6c2-463a-8261-402eb922120e req-11bcb8bd-8f95-4aba-8ece-1ab704de365b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:51:59.679757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-0a2212a2-d6c2-463a-8261-402eb922120e req-11bcb8bd-8f95-4aba-8ece-1ab704de365b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:51:59.693478 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-0a2212a2-d6c2-463a-8261-402eb922120e req-11bcb8bd-8f95-4aba-8ece-1ab704de365b service nova] Creating event network-changed:1a37892d-e555-40b3-af75-2110c6c4fd34 for instance 430ecb3c-5a38-48a6-8054-84029ce9705e on hv-cinder-83608 Sep 26 05:51:59.698680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-0a2212a2-d6c2-463a-8261-402eb922120e req-11bcb8bd-8f95-4aba-8ece-1ab704de365b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034106 Sep 26 05:51:59.699303 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 371/750] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:52:00.590243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:00.594619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:00.605419 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:00.606436 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:00.607152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:00.608417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:00.609246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:00.609880 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:00.674136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ceb0898c-e1be-4e16-b546-e6d35eb07953 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091991 Sep 26 05:52:00.675151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 380/751] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:52:00 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:01.691614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:01.693871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:01.700773 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:01.701361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:01.701794 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:01.702506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:01.702985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:01.703438 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:01.735026 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dab3f31a-ae85-46a6-bc47-73b3f078bdfc tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051084 Sep 26 05:52:01.735602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 372/752] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:52:01 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:52:01.844821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:01.845456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:01.852294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:01.852780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:01.853247 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:01.853999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:01.854451 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:01.854866 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:01.882163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:52:01.966142 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-78b2e82b-3c2a-43d9-9161-be99613478dd tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 204 len: 0 microversion: 2.1 time: 0.124136 Sep 26 05:52:01.967127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 381/753] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:52:01 2022] DELETE /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:52:01.975763 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:01.976374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:01.982880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:01.983365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:01.983827 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:01.984523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:01.984975 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:01.985431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:01.991337 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:02.131892 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:02.142880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-73c588d1-1005-41ad-93d7-9bb095f68120 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1688 microversion: 2.1 time: 0.171069 Sep 26 05:52:02.143479 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 373/754] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:01 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:03.167184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:03.167914 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:03.174816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:03.175301 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:03.175739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:03.176452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:03.176884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:03.177349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:03.321703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:03.329793 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8331e540-62ad-41d6-8f36-68e951ae53fe tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1688 microversion: 2.1 time: 0.167069 Sep 26 05:52:03.330371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 382/755] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:03 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:04.356535 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:04.357688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:04.366841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:04.367511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:04.368015 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:04.368838 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:04.369524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:04.370094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:04.540945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:04.550770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-911017da-6b60-4c55-b137-c24cab005625 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1688 microversion: 2.1 time: 0.201128 Sep 26 05:52:04.551640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 374/756] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:04 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:05.200523 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:05.202841 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:05.209856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.210786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.211254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.212067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.212530 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.212950 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.246779 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-99412af7-fa7b-4df4-8cd1-9764a3e77775 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049954 Sep 26 05:52:05.247381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 383/757] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:52:05 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:52:05.315782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:05.316305 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:05.322658 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.323159 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.323592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.324297 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.324859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.325311 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.352079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:52:05.441401 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ec912eaa-afc7-4886-b7cd-37b4e357d47f tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 204 len: 0 microversion: 2.1 time: 0.129513 Sep 26 05:52:05.442528 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 375/758] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:52:05 2022] DELETE /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 05:52:05.452302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:05.453111 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:05.460093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.461120 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.461773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.462685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.463277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.463795 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.579196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:05.579628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:05.586745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.587236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.587683 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.588412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:05.590644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:05.590644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:05.605643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:05.615273 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-785ffd3e-fe6a-46de-bb5d-912eef11bbde tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1674 microversion: 2.1 time: 0.167901 Sep 26 05:52:05.615981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 384/759] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:05 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:52:05.775214 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:05.784496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-58395069-8de9-4744-9b13-a420b8d5204b tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1688 microversion: 2.1 time: 0.210553 Sep 26 05:52:05.785127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 376/760] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:05 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:06.651131 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:06.651778 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:06.658620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:06.659110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:06.659540 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:06.660239 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:06.660695 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:06.661112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:06.812070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:06.822178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-11935546-7f01-48ff-b3ff-e6da88d038f1 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1674 microversion: 2.1 time: 0.175818 Sep 26 05:52:06.823110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 385/761] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:06 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:06.825325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:06.826312 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:06.834577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:06.835464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:06.836137 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:06.837038 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:06.837608 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:06.838095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:07.024996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:07.035162 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a4cd17c5-87b8-4414-bce3-bd55ead0cd39 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1688 microversion: 2.1 time: 0.214479 Sep 26 05:52:07.035932 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 377/762] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:06 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1688 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:52:07.393635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ed09ab6c-1ac5-4649-8236-8607eee43833 req-2d100c0e-692e-43ff-a996-dc435c754ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09331c3-4186-46a6-abeb-f3e5ef0ec10d", "name": "network-vif-deleted", "tag": "438d048d-b815-4fa3-98df-918b47d1b86c"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:07.406701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ed09ab6c-1ac5-4649-8236-8607eee43833 req-2d100c0e-692e-43ff-a996-dc435c754ee6 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:07.407518 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ed09ab6c-1ac5-4649-8236-8607eee43833 req-2d100c0e-692e-43ff-a996-dc435c754ee6 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:07.408264 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ed09ab6c-1ac5-4649-8236-8607eee43833 req-2d100c0e-692e-43ff-a996-dc435c754ee6 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:07.468375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ed09ab6c-1ac5-4649-8236-8607eee43833 req-2d100c0e-692e-43ff-a996-dc435c754ee6 service nova] Creating event network-vif-deleted:438d048d-b815-4fa3-98df-918b47d1b86c for instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d on hv-cinder-83608 Sep 26 05:52:07.477810 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ed09ab6c-1ac5-4649-8236-8607eee43833 req-2d100c0e-692e-43ff-a996-dc435c754ee6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095095 Sep 26 05:52:07.482590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 386/763] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:07.847641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:07.848494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:07.861302 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:07.862309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:07.862861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:07.863858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:07.865458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:07.865995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:07.946963 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:07.959483 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6dcf19b6-d7c2-4076-8ed6-52baf45d6d04 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1606 microversion: 2.1 time: 0.115585 Sep 26 05:52:07.960082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 378/764] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:07 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1606 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:08.061045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:08.062033 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:08.069021 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:08.069560 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:08.069984 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:08.070895 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:08.071539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:08.071951 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:08.107677 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:08.108081 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:08.108507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:08.109224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lazy-loading 'fault' on Instance uuid a09331c3-4186-46a6-abeb-f3e5ef0ec10d {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:52:08.170854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:08.171958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-acb759da-a5cf-4411-af39-db2fa648be1e req-d67fe8b0-5e54-4491-9586-99fa36910d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0853094-da33-4e22-a597-b0df1980229b", "name": "network-vif-deleted", "tag": "874e44a1-6cb8-479e-b4b0-e68322b26e1f"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:08.181983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-acb759da-a5cf-4411-af39-db2fa648be1e req-d67fe8b0-5e54-4491-9586-99fa36910d3f service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:08.182864 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-acb759da-a5cf-4411-af39-db2fa648be1e req-d67fe8b0-5e54-4491-9586-99fa36910d3f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:08.183073 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-db71de7f-ffe2-42e9-9e68-efa74759877c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 200 len: 1334 microversion: 2.1 time: 0.126712 Sep 26 05:52:08.183679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 387/765] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:08 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 1334 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:08.183890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-acb759da-a5cf-4411-af39-db2fa648be1e req-d67fe8b0-5e54-4491-9586-99fa36910d3f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:08.197315 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-acb759da-a5cf-4411-af39-db2fa648be1e req-d67fe8b0-5e54-4491-9586-99fa36910d3f service nova] Creating event network-vif-deleted:874e44a1-6cb8-479e-b4b0-e68322b26e1f for instance a0853094-da33-4e22-a597-b0df1980229b on hv-cinder-83608 Sep 26 05:52:08.203612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-acb759da-a5cf-4411-af39-db2fa648be1e req-d67fe8b0-5e54-4491-9586-99fa36910d3f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Sep 26 05:52:08.204477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 379/766] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:52:08.988675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:08.989377 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:08.996470 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:08.997061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:08.997750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:08.998461 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:08.999141 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:08.999557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:09.035476 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:09.035958 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:09.036398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:09.036937 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lazy-loading 'fault' on Instance uuid a0853094-da33-4e22-a597-b0df1980229b {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:52:09.090883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:09.101254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-43c4c7d8-8b23-486f-8e3b-1f71735dc036 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 200 len: 1327 microversion: 2.1 time: 0.121089 Sep 26 05:52:09.102254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 388/767] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:08 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:09.208499 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:09.209981 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: a09331c3-4186-46a6-abeb-f3e5ef0ec10d] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:09.225845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:09.226700 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:09.227140 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:09.228084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:09.228558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:09.229249 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:09.245105 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] HTTP exception thrown: Instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d could not be found. Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Request method failure captured: Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d HTTP/1.1 Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTwuaeuiG1qEQW0yjIPlpAPCpETHlr3RkHfKHI77C36DLeEjWyQ-XCnBZEZlkc1WqJ97pFpT_tY7DIlUs-AKhwH8GY1zD-qTM2D8gX9po477irnUEgFVnpKPjqMdxNkYYhTcRBEpUSbqPfEPbkUdDdvjbjIYTsK27n7S_vPXUyYuY3o Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:09.246855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c95cba08e61d4d199a3c69d99c5bc77b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 342ce12282264d40b2f2bb6f1fc6ba25 Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d could not be found. Sep 26 05:52:09.248256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'a09331c3-4186-46a6-abeb-f3e5ef0ec10d'} Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d could not be found. Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:09.249090 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d could not be found. Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d could not be found. Sep 26 05:52:09.250428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:09.251578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Returning 404 to user: Instance a09331c3-4186-46a6-abeb-f3e5ef0ec10d could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:09.251578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-67098b86-00b8-4322-9b64-0556fb384108 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d" status: 404 len: 111 microversion: 2.1 time: 0.045765 Sep 26 05:52:09.251578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 380/768] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:09 2022] GET /compute/v2.1/servers/a09331c3-4186-46a6-abeb-f3e5ef0ec10d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:52:09.257537 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d52a9968-3f93-4109-8f44-eb432ecf9793 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '.version_select at 0x7f1e5e410ee0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:09.284719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d52a9968-3f93-4109-8f44-eb432ecf9793 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951590994" status: 202 len: 0 microversion: 2.1 time: 0.030995 Sep 26 05:52:09.285583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 389/769] 10.222.0.57 () {58 vars in 1218 bytes} [Mon Sep 26 05:52:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951590994 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:52:10.128114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:10.128730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:10.135318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:10.135848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:10.136283 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:10.136995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:10.137762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:10.138184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:10.153069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] HTTP exception thrown: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Request method failure captured: Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b HTTP/1.1 Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw2Uk72LS3P-k37oBL5TM0tyQo8Uj8xzZfHGDGAR-UjjBQuKYYErMJ9iwFB8F945IWFVXu-Svs0pq48SbhmEfk9Xj_RetiH0jOmsEAUt-_i3GnbSugO3bCWnq_Pn84YqQfgV24GYgK7Zrt_i1PBzlgtXxf19__OKHi0eBlXWJrDCQ8 Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:10.154832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9fc5a928f77549839c85f3ab7e7e13b6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 8c26eec9a5e841f8b760cc8cef309b18 Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:52:10.156165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'a0853094-da33-4e22-a597-b0df1980229b'} Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:10.156992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:52:10.158808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:10.160086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Returning 404 to user: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:10.160086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ba531188-b3a9-405b-bd45-9fd22a876495 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 404 len: 111 microversion: 2.1 time: 0.033711 Sep 26 05:52:10.160086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 381/770] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:10 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:52:10.165920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9c11190b-bcec-4381-88bf-f8491f9de376 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '.version_select at 0x7f1e5e4290d0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:10.193600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9c11190b-bcec-4381-88bf-f8491f9de376 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455244803" status: 202 len: 0 microversion: 2.1 time: 0.031632 Sep 26 05:52:10.194190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 390/771] 10.222.0.57 () {58 vars in 1218 bytes} [Mon Sep 26 05:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455244803 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:52:11.225266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-950d5261-a5c2-41fb-955a-57e9cbc7576d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'create', calling method: .version_select at 0x7f1e5e343af0>, body: {"keypair": {"name": "tempest-keypair-1303644116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2LF+/+fRkPh/W9jEptIbo4KUT8whoyvj256BcVw4CchcbUM7egPdX2zOIZJU0ijnSkZd3FklgmfB9irgaNbJpfI79YDVbEjU4YTsTY+ZcaCXDJkO0SPPz3KRUSvI2JPg=="}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:11.242380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-950d5261-a5c2-41fb-955a-57e9cbc7576d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:52:11.246772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-950d5261-a5c2-41fb-955a-57e9cbc7576d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for user 8c26eec9a5e841f8b760cc8cef309b18 and project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:52:11.271346 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-950d5261-a5c2-41fb-955a-57e9cbc7576d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049654 Sep 26 05:52:11.272280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 382/772] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:52:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:12.600464 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:12.600995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:12.607674 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:12.608163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:12.608592 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:12.609327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:12.609782 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:12.610514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:12.639427 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:52:12.719669 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-26b418b3-d9c3-424d-a24c-5c3e82c7691e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 204 len: 0 microversion: 2.1 time: 0.123456 Sep 26 05:52:12.720254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 391/773] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:52:12 2022] DELETE /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:52:12.724301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1018441053", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a39f8ffc-12a2-4c17-a0f2-be5f6071fe30"}], "security_groups": [{"name": "tempest-securitygroup--1362753334"}], "key_name": "tempest-keypair-1303644116", "user_data": "}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:12.728497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:12.729197 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:12.735272 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:12.735760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:12.736184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:12.736869 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:12.737354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:12.737834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:12.838190 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] validate_networks() for [('a39f8ffc-12a2-4c17-a0f2-be5f6071fe30', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:52:12.876457 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:12.884638 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4c59a8d5-1112-4d1b-8774-f3034cd9582f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1507 microversion: 2.1 time: 0.159987 Sep 26 05:52:12.885245 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 392/774] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:12 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:52:13.251199 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:52:13.251810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:52:13.252562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:52:13.253114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:52:13.253568 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:52:13.267229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:13.267818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:13.268405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:13.269656 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:13.270206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:13.270759 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:13.290958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:52:13.295062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Getting quotas for user 8c26eec9a5e841f8b760cc8cef309b18 and project 9fc5a928f77549839c85f3ab7e7e13b6. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:52:13.305990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:52:13.308303 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:52:13.363443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d9584c81-5909-4789-b5e9-aa1300d3d367 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.651068 Sep 26 05:52:13.364396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 383/775] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:52:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 05:52:13.378913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d1d9851e-bebe-4522-9379-0bdbbc232485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:13.379456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d1d9851e-bebe-4522-9379-0bdbbc232485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:13.435251 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d1d9851e-bebe-4522-9379-0bdbbc232485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:13.442529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d1d9851e-bebe-4522-9379-0bdbbc232485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1238 microversion: 2.1 time: 0.067580 Sep 26 05:52:13.443169 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 393/776] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:13 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:13.909492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:13.910132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:13.918497 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:13.918988 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:13.919740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:13.920447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:13.920898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:13.921343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:14.071439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:14.079769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a930940c-2964-4b92-b3c4-fd1a3123a41c tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1507 microversion: 2.1 time: 0.174960 Sep 26 05:52:14.080525 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 384/777] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:13 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:14.420811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-9ded499e-b919-4692-bde5-abde53aa772e req-33366e68-9369-4a26-899b-c5055fd2f08e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3be8a7-e6e0-46f0-bfdb-df514845bcb7", "name": "network-vif-deleted", "tag": "a2412a97-1a6a-48d8-a7a8-27786cf5d323"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:14.431242 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-9ded499e-b919-4692-bde5-abde53aa772e req-33366e68-9369-4a26-899b-c5055fd2f08e service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:14.432015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-9ded499e-b919-4692-bde5-abde53aa772e req-33366e68-9369-4a26-899b-c5055fd2f08e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:14.432612 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-9ded499e-b919-4692-bde5-abde53aa772e req-33366e68-9369-4a26-899b-c5055fd2f08e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:14.437054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:14.444639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-9ded499e-b919-4692-bde5-abde53aa772e req-33366e68-9369-4a26-899b-c5055fd2f08e service nova] Creating event network-vif-deleted:a2412a97-1a6a-48d8-a7a8-27786cf5d323 for instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 on hv-cinder-83608 Sep 26 05:52:14.449762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-9ded499e-b919-4692-bde5-abde53aa772e req-33366e68-9369-4a26-899b-c5055fd2f08e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Sep 26 05:52:14.450357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 394/778] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:14.465401 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:14.466086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:14.473770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:14.474318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:14.475140 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:14.475562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:14.476019 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:14.476639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:14.545548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:14.553977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-970c82bc-418e-4460-9b9c-16e2bcfeabb9 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1290 microversion: 2.1 time: 0.092448 Sep 26 05:52:14.554571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 385/779] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:14 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:15.106372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:15.108258 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:15.117806 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:15.118301 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:15.118732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:15.119439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:15.119894 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:15.120346 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:15.152506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:15.153065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:15.153507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:15.153974 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lazy-loading 'fault' on Instance uuid 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:52:15.196238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:15.204254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4969e512-431e-4a78-895f-7ea3dc878e3f tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 200 len: 1312 microversion: 2.1 time: 0.103020 Sep 26 05:52:15.204828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 395/780] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:15 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:52:15.578056 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:15.578908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:15.587490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:15.588108 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:15.588613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:15.589439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:15.589968 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:15.590700 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:15.662699 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:15.671441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7f802c33-12e3-4099-9d19-6f3f499b64f5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1296 microversion: 2.1 time: 0.097258 Sep 26 05:52:15.672491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 386/781] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:15 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1296 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:16.228080 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:16.230023 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:16.237698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.238194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.238630 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.239343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.239867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.240363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.255022 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] HTTP exception thrown: Instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 could not be found. Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Request method failure captured: Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 HTTP/1.1 Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTwuaeuiG1qEQW0yjIPlpAPCpETHlr3RkHfKHI77C36DLeEjWyQ-XCnBZEZlkc1WqJ97pFpT_tY7DIlUs-AKhwH8GY1zD-qTM2D8gX9po477irnUEgFVnpKPjqMdxNkYYhTcRBEpUSbqPfEPbkUdDdvjbjIYTsK27n7S_vPXUyYuY3o Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:52:16.256682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c95cba08e61d4d199a3c69d99c5bc77b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 342ce12282264d40b2f2bb6f1fc6ba25 Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 could not be found. Sep 26 05:52:16.258274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '1f3be8a7-e6e0-46f0-bfdb-df514845bcb7'} Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 could not be found. Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:16.262183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 could not be found. Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 could not be found. Sep 26 05:52:16.263459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:16.264642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Returning 404 to user: Instance 1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:16.264642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c2bde1bd-cf6b-452d-876c-fa4ae59b6592 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7" status: 404 len: 111 microversion: 2.1 time: 0.034111 Sep 26 05:52:16.264642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 396/782] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:16 2022] GET /compute/v2.1/servers/1f3be8a7-e6e0-46f0-bfdb-df514845bcb7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:52:16.268690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:16.269225 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:16.275772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.276261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.276789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.277622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.278256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.278731 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.306383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:52:16.388215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a9235481-f318-4e2a-88e9-f451ce6cec85 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "DELETE /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 204 len: 0 microversion: 2.1 time: 0.123050 Sep 26 05:52:16.389326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 387/783] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:52:16 2022] DELETE /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:52:16.397747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:16.398359 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:16.404819 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.405229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.405670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.406403 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.406879 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.407295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.609317 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:16.618297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-aef7a540-8ea9-40ac-a157-12bbb881b8be tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.224315 Sep 26 05:52:16.618997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 397/784] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:16 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:16.696446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:16.697261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:16.704210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.704667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.705178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.706021 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.706534 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.707548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.731355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-70775f48-81c8-4902-b73e-07bf0d489a76 req-a02a5d4c-7727-4c7c-95c4-9d2779bb4e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d8c38d1-af64-4696-bdab-e85587332b6e", "tag": "75b4cfd2-89be-4ea3-90ab-3906f010564d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:16.742138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-70775f48-81c8-4902-b73e-07bf0d489a76 req-a02a5d4c-7727-4c7c-95c4-9d2779bb4e88 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:16.742785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-70775f48-81c8-4902-b73e-07bf0d489a76 req-a02a5d4c-7727-4c7c-95c4-9d2779bb4e88 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:16.743356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-70775f48-81c8-4902-b73e-07bf0d489a76 req-a02a5d4c-7727-4c7c-95c4-9d2779bb4e88 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:16.756890 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-70775f48-81c8-4902-b73e-07bf0d489a76 req-a02a5d4c-7727-4c7c-95c4-9d2779bb4e88 service nova] Creating event network-changed:75b4cfd2-89be-4ea3-90ab-3906f010564d for instance 7d8c38d1-af64-4696-bdab-e85587332b6e on hv-cinder-83608 Sep 26 05:52:16.763172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-70775f48-81c8-4902-b73e-07bf0d489a76 req-a02a5d4c-7727-4c7c-95c4-9d2779bb4e88 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035562 Sep 26 05:52:16.766360 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 398/785] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:16.851248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:16.859182 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-59b9b625-8782-4d60-8abf-f1ff2c5e7198 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.167223 Sep 26 05:52:16.859750 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 388/786] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:16 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:17.643482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:17.644174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:17.651477 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:17.652187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:17.652816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:17.653746 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:17.656107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:17.656107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:17.825998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:17.834092 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1595e253-2076-4f5a-9c03-710a7f696d89 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1520 microversion: 2.1 time: 0.194774 Sep 26 05:52:17.834704 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 399/787] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:17 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:17.882675 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:17.883328 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:17.890403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:17.890903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:17.891341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:17.892058 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:17.892519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:17.892946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:18.096723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:18.105238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-266b99b4-13e2-4705-8c1f-0817996a7816 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.226572 Sep 26 05:52:18.105829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 389/788] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:17 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:18.186467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-15daedd0-5797-42e6-a4ea-4cdb2a1b1761 req-95c526cb-e1f0-45f5-a996-f306faf945f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc", "name": "network-vif-deleted", "tag": "811e152d-7a22-4e01-ad08-ecb9adcd493b"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:18.197361 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-15daedd0-5797-42e6-a4ea-4cdb2a1b1761 req-95c526cb-e1f0-45f5-a996-f306faf945f4 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:18.197870 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-15daedd0-5797-42e6-a4ea-4cdb2a1b1761 req-95c526cb-e1f0-45f5-a996-f306faf945f4 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:18.198325 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-15daedd0-5797-42e6-a4ea-4cdb2a1b1761 req-95c526cb-e1f0-45f5-a996-f306faf945f4 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:18.210075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-15daedd0-5797-42e6-a4ea-4cdb2a1b1761 req-95c526cb-e1f0-45f5-a996-f306faf945f4 service nova] Creating event network-vif-deleted:811e152d-7a22-4e01-ad08-ecb9adcd493b for instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc on hv-cinder-83608 Sep 26 05:52:18.215589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-15daedd0-5797-42e6-a4ea-4cdb2a1b1761 req-95c526cb-e1f0-45f5-a996-f306faf945f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033067 Sep 26 05:52:18.216197 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 400/789] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:18.858823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:18.859462 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:18.866062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:18.866557 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:18.866978 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:18.867684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:18.868131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:18.868547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:18.873651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:18.937614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:18.946299 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5fd86ed2-b994-4ee8-9c53-94db52a93b5e tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1478 microversion: 2.1 time: 0.091995 Sep 26 05:52:18.946896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 390/790] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:18 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1478 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:19.129617 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:19.130246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:19.137173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:19.137736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:19.138171 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:19.138887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:19.139337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:19.139756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:19.287197 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:19.295511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e62cb5df-9a82-4ec8-aa9e-f12c6fb618c6 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.170839 Sep 26 05:52:19.296101 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 401/791] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:19 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:19.970541 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:19.971249 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:19.978562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:19.979051 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:19.979482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:19.980178 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:19.980631 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:19.981047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:20.049160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:20.058387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-409471b9-e7bc-419f-980a-5172e2a47ed6 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1478 microversion: 2.1 time: 0.091688 Sep 26 05:52:20.059006 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 391/792] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:19 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1478 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:52:20.319078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:20.319805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:20.322173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:20.328207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:20.328700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:20.329151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:20.329858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:20.330312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:20.330737 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:20.480586 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:20.489539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-26aa0b44-1c61-4dbe-9792-ae8d5cb8be49 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.174157 Sep 26 05:52:20.490043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 402/793] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:20 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:21.082419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:21.083055 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:21.092082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:21.092082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:21.092082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:21.092530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:21.092787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:21.093439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:21.130871 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:21.131540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:21.131891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:21.132214 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lazy-loading 'fault' on Instance uuid 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:52:21.242781 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342ce12282264d40b2f2bb6f1fc6ba25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c95cba08e61d4d199a3c69d99c5bc77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:21.251117 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-76f17c9d-0ce9-4e18-be00-f81cb956b281 tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 200 len: 1311 microversion: 2.1 time: 0.174082 Sep 26 05:52:21.251724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 392/794] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:21 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:21.512901 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:21.513574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:21.520659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:21.521176 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:21.521591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:21.522307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:21.522754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:21.523177 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:21.600464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2141064964"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:21.601388 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:21.604771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:21.614047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:21.614897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:21.615655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:21.624545 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:21.625069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:21.625530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:21.690269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:21.699287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6776e0a0-5541-4d2d-a44d-cb3e1e69f98c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.190790 Sep 26 05:52:21.700590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 403/795] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:21 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:22.275772 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:22.276409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] [instance: 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:22.281456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.network.security_group_api [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Removing security group 614dd8f1-649a-4178-9413-96e4743e870b from port cfc17f70-ed8d-4384-a96d-8f2f72a15f6d Sep 26 05:52:22.283819 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:22.284303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:22.284953 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:22.285704 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:22.286148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:22.286571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:22.305684 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] HTTP exception thrown: Instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc could not be found. Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Request method failure captured: Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc HTTP/1.1 Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTwuaeuiG1qEQW0yjIPlpAPCpETHlr3RkHfKHI77C36DLeEjWyQ-XCnBZEZlkc1WqJ97pFpT_tY7DIlUs-AKhwH8GY1zD-qTM2D8gX9po477irnUEgFVnpKPjqMdxNkYYhTcRBEpUSbqPfEPbkUdDdvjbjIYTsK27n7S_vPXUyYuY3o Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:52:22.307375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c95cba08e61d4d199a3c69d99c5bc77b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c95cba08e61d4d199a3c69d99c5bc77b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: c95cba08e61d4d199a3c69d99c5bc77b Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-349765895 Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 342ce12282264d40b2f2bb6f1fc6ba25 Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-ServerRescueNegativeTestJSON-349765895-project Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc could not be found. Sep 26 05:52:22.310753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc'} Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc could not be found. Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:22.312546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc could not be found. Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc could not be found. Sep 26 05:52:22.316811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:52:22.324407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] Returning 404 to user: Instance 69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:22.324407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-24ccd18e-cd38-4c89-b0a7-7d6bcd06b6db tempest-ServerRescueNegativeTestJSON-349765895 tempest-ServerRescueNegativeTestJSON-349765895-project] 10.222.0.57 "GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc" status: 404 len: 111 microversion: 2.1 time: 0.037199 Sep 26 05:52:22.324407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 404/796] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:22 2022] GET /compute/v2.1/servers/69d07cfb-fde7-4db5-8f9d-77aaad3a3ddc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:52:22.687143 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-eeafdd63-3aa6-4cb0-a42d-0043c7031ad6 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/action" status: 202 len: 0 microversion: 2.1 time: 1.093992 Sep 26 05:52:22.688530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 393/797] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 05:52:21 2022] POST /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/action => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:52:22.696825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ff94edb8-87ad-4b6d-bcb2-6b3b9e708900 req-07f6c821-7254-4bf5-8d59-448d8691760e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700b7726-3a5c-412e-973f-02740f96edde", "tag": "cfc17f70-ed8d-4384-a96d-8f2f72a15f6d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:22.708018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ff94edb8-87ad-4b6d-bcb2-6b3b9e708900 req-07f6c821-7254-4bf5-8d59-448d8691760e service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:22.708815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ff94edb8-87ad-4b6d-bcb2-6b3b9e708900 req-07f6c821-7254-4bf5-8d59-448d8691760e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:22.709443 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ff94edb8-87ad-4b6d-bcb2-6b3b9e708900 req-07f6c821-7254-4bf5-8d59-448d8691760e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:22.724282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:22.725370 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:22.735036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:22.737652 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:22.739200 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ff94edb8-87ad-4b6d-bcb2-6b3b9e708900 req-07f6c821-7254-4bf5-8d59-448d8691760e service nova] Creating event network-changed:cfc17f70-ed8d-4384-a96d-8f2f72a15f6d for instance 700b7726-3a5c-412e-973f-02740f96edde on hv-cinder-83608 Sep 26 05:52:22.739895 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:22.740821 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:22.741987 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:22.744046 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:22.753303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ff94edb8-87ad-4b6d-bcb2-6b3b9e708900 req-07f6c821-7254-4bf5-8d59-448d8691760e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057053 Sep 26 05:52:22.758061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 405/798] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:23.122611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:23.154277 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9fc77808-2911-47e3-91c6-e8d54f94fd57 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.431159 Sep 26 05:52:23.157950 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 394/799] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:22 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:52:24.180779 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:24.182775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:24.186422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:24.193058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:24.193058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:24.193058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:24.196053 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:24.196053 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:24.196053 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:24.405320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:24.407180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:24.413274 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:24.413956 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=10 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:24.417785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:24.418518 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:24.419128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:24.420028 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:24.420669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:24.422032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:24.498620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:24.524138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-72efbdbd-832d-459b-8783-1cc1802af044 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.347291 Sep 26 05:52:24.525643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 406/800] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:24 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:24.563290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lazy-loading 'services' on Instance uuid 700b7726-3a5c-412e-973f-02740f96edde {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:52:24.652768 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fb2ffc98-e075-4208-a102-ca73a0768f2c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "DELETE /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments/d19772e8-a73f-419e-94b7-651550e57135" status: 202 len: 0 microversion: 2.1 time: 0.254570 Sep 26 05:52:24.654089 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 395/801] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:52:24 2022] DELETE /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments/d19772e8-a73f-419e-94b7-651550e57135 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:52:24.664966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:24.669702 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:24.686452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:24.687584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:24.688409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:24.689609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:24.690368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:24.691093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:24.760200 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2aab6b85-7e43-4db0-9cd0-a3e5b651b51a tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100238 Sep 26 05:52:24.761573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 407/802] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:52:24 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:24.815479 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-1c0bbe7e-bf92-41e9-a2d8-4d741c0448df req-45114def-68fa-49dd-ab33-5dd587b260f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700b7726-3a5c-412e-973f-02740f96edde", "tag": "cfc17f70-ed8d-4384-a96d-8f2f72a15f6d"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:24.836847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-1c0bbe7e-bf92-41e9-a2d8-4d741c0448df req-45114def-68fa-49dd-ab33-5dd587b260f9 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:24.837361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-1c0bbe7e-bf92-41e9-a2d8-4d741c0448df req-45114def-68fa-49dd-ab33-5dd587b260f9 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:24.837789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-1c0bbe7e-bf92-41e9-a2d8-4d741c0448df req-45114def-68fa-49dd-ab33-5dd587b260f9 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:24.850240 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-1c0bbe7e-bf92-41e9-a2d8-4d741c0448df req-45114def-68fa-49dd-ab33-5dd587b260f9 service nova] Creating event network-changed:cfc17f70-ed8d-4384-a96d-8f2f72a15f6d for instance 700b7726-3a5c-412e-973f-02740f96edde on hv-cinder-83608 Sep 26 05:52:24.856179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-1c0bbe7e-bf92-41e9-a2d8-4d741c0448df req-45114def-68fa-49dd-ab33-5dd587b260f9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044702 Sep 26 05:52:24.857330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 396/803] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:25.287545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ea3a5eb3-9702-4168-b4ad-f7e71026991b req-07b1c416-c1a7-46d4-a52e-df6f45d62ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d8c38d1-af64-4696-bdab-e85587332b6e", "name": "network-vif-plugged", "status": "completed", "tag": "75b4cfd2-89be-4ea3-90ab-3906f010564d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:25.299863 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ea3a5eb3-9702-4168-b4ad-f7e71026991b req-07b1c416-c1a7-46d4-a52e-df6f45d62ff1 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:25.300656 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ea3a5eb3-9702-4168-b4ad-f7e71026991b req-07b1c416-c1a7-46d4-a52e-df6f45d62ff1 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:25.301389 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ea3a5eb3-9702-4168-b4ad-f7e71026991b req-07b1c416-c1a7-46d4-a52e-df6f45d62ff1 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:25.315670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ea3a5eb3-9702-4168-b4ad-f7e71026991b req-07b1c416-c1a7-46d4-a52e-df6f45d62ff1 service nova] Creating event network-vif-plugged:75b4cfd2-89be-4ea3-90ab-3906f010564d for instance 7d8c38d1-af64-4696-bdab-e85587332b6e on hv-cinder-83608 Sep 26 05:52:25.322553 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ea3a5eb3-9702-4168-b4ad-f7e71026991b req-07b1c416-c1a7-46d4-a52e-df6f45d62ff1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Sep 26 05:52:25.323880 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 408/804] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:25.574368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:25.575260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:25.583954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:25.584650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:25.585501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:25.586349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:25.586828 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:25.587264 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:25.776355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:25.778702 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:25.785557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:25.786509 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:25.787314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:25.788351 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:25.789474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:25.793504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:25.839906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fb94a14a-92a1-48d7-a7a8-614dfbf317b9 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067826 Sep 26 05:52:25.841103 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 409/805] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:52:25 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:26.151769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:26.160490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-db39fffb-e78a-429b-b61a-6bcb94cbd38b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.592681 Sep 26 05:52:26.161170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 397/806] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:25 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:26.851918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:26.854775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:26.862324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:26.862884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:26.863350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:26.864709 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:26.865396 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:26.866015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:26.901913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-57c36f5e-0b77-4354-a97e-b3b9817d3b7c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053791 Sep 26 05:52:26.908485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 410/807] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:52:26 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:52:26.914166 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:26.915283 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:26.921757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:26.922468 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:26.923122 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:26.924050 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:26.924702 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:26.932024 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:27.029804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] HTTP exception thrown: Instance 700b7726-3a5c-412e-973f-02740f96edde is not attached to volume d19772e8-a73f-419e-94b7-651550e57135 Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Request method failure captured: Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments/d19772e8-a73f-419e-94b7-651550e57135 HTTP/1.1 Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT0KLk-RoEzYXIu9cK4BfNgL9PV1kjo0laMZcTKv9eIZYIJFMKsCWU1Qt8zqbEAaxCg9plfmFICeBqq-G4pUMUGETqOqNxP7Ok7Di-otes9-p_bj93J6f8e7Q4ktE3U8D8vxyEa7pS9QnSk2JOxvcci9KDefxJTOTwr0LEQ1RxxIVok Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 0b095f1ee00e46cfabebc2dc34992997 Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-TestMinimumBasicScenario-250193205 Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:27.032618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0b095f1ee00e46cfabebc2dc34992997"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0b095f1ee00e46cfabebc2dc34992997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0b095f1ee00e46cfabebc2dc34992997"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0b095f1ee00e46cfabebc2dc34992997", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-TestMinimumBasicScenario-250193205 Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 0b095f1ee00e46cfabebc2dc34992997 Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-TestMinimumBasicScenario-250193205 Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-TestMinimumBasicScenario-250193205-project Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 3cab2568112f46bca576f17916887aa7 Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-TestMinimumBasicScenario-250193205-project Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:52:27.034121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 700b7726-3a5c-412e-973f-02740f96edde is not attached to volume d19772e8-a73f-419e-94b7-651550e57135 Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'server_id': '700b7726-3a5c-412e-973f-02740f96edde', 'id': 'd19772e8-a73f-419e-94b7-651550e57135'} Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d19772e8-a73f-419e-94b7-651550e57135. Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:27.034840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 700b7726-3a5c-412e-973f-02740f96edde is not attached to volume d19772e8-a73f-419e-94b7-651550e57135 Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 700b7726-3a5c-412e-973f-02740f96edde is not attached to volume d19772e8-a73f-419e-94b7-651550e57135 Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:27.035994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Returning 404 to user: Instance 700b7726-3a5c-412e-973f-02740f96edde is not attached to volume d19772e8-a73f-419e-94b7-651550e57135 {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:27.036921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bbb120c7-1741-4a2d-b166-39ce26f1d943 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "DELETE /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments/d19772e8-a73f-419e-94b7-651550e57135" status: 404 len: 154 microversion: 2.1 time: 0.124649 Sep 26 05:52:27.036921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 398/808] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:52:26 2022] DELETE /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde/os-volume_attachments/d19772e8-a73f-419e-94b7-651550e57135 => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:52:27.183929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:27.184458 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:27.190834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:27.191191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:27.191626 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:27.192545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:27.193234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:27.193661 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:27.443353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:27.452271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a209a40e-acd6-4b8f-bccb-89fb38f77288 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1364 microversion: 2.1 time: 0.272195 Sep 26 05:52:27.452860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 411/809] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:27 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:28.197097 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:28.197652 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:28.204445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.204935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.205390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.206088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.206542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.206960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.242066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:52:28.327308 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6fdf51ad-1d3f-4a56-b420-b5a362bb415c tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "DELETE /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 204 len: 0 microversion: 2.1 time: 0.134041 Sep 26 05:52:28.327960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 399/810] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:52:28 2022] DELETE /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:52:28.337607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:28.338212 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:28.345106 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.345773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.346296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.347095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.347541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.348151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.491724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:28.500813 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-00b123c6-09af-49de-9511-e0ade33d34c1 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1555 microversion: 2.1 time: 0.168038 Sep 26 05:52:28.501490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 412/811] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:28 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:28.506173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:28.509444 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:28.512826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b8ed5fe6-8d23-4020-b554-92c3e4772581 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Action: 'create', calling method: .version_select at 0x7f1e5e7ec550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-184459102", "metadata": {"Type": "work"}}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:28.515855 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.516373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.516882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.517591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.518075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.518488 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b8ed5fe6-8d23-4020-b554-92c3e4772581 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Request method failure captured: Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 121 Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT4cpipBzvDRc4I4Uuki6F2st6yogdtqcfK3KJuUcp-kp2FxPLQDso1j0C2vHa1nrE3aXQNEcVnN_ZmzBsUIk3jfuio02cGDqhvyAeLaNcWu9P0jksw155_-2XaRgCBzIK1X96tE0amNVdPRSBuvuf8-0KZfc0vyxmYGswunWJC6DoU Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:28.528210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_15d8f644bc9342379a8c6007f00aa363", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 09f95547d1a04222a7965b83918905aa Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-184459102", "metadata": {"Type": "work"}}} Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:52:28.529904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-184459102', 'metadata': {'Type': 'work'}}}} Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise error Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi '#$%' Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:28.531492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 05:52:28.533527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 05:52:28.534890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 05:52:28.534890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.534890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b8ed5fe6-8d23-4020-b554-92c3e4772581 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:28.534890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b8ed5fe6-8d23-4020-b554-92c3e4772581 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.174129 Sep 26 05:52:28.534890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 400/812] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Sep 26 05:52:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 05:52:28.542135 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b73bafa0-8af6-4d71-91f8-b449ebf97624 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Action: 'create', calling method: .version_select at 0x7f1e5e2a8550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-122840352", "metadata": {"Type": "work"}}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b73bafa0-8af6-4d71-91f8-b449ebf97624 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Request method failure captured: Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 119 Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT4cpipBzvDRc4I4Uuki6F2st6yogdtqcfK3KJuUcp-kp2FxPLQDso1j0C2vHa1nrE3aXQNEcVnN_ZmzBsUIk3jfuio02cGDqhvyAeLaNcWu9P0jksw155_-2XaRgCBzIK1X96tE0amNVdPRSBuvuf8-0KZfc0vyxmYGswunWJC6DoU Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:28.546996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_15d8f644bc9342379a8c6007f00aa363", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 09f95547d1a04222a7965b83918905aa Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-122840352", "metadata": {"Type": "work"}}} Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:52:28.548646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-122840352', 'metadata': {'Type': 'work'}}}} Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise error Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi '0' Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:28.549514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 05:52:28.551103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 05:52:28.552570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 05:52:28.552570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.552570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b73bafa0-8af6-4d71-91f8-b449ebf97624 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:28.552570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b73bafa0-8af6-4d71-91f8-b449ebf97624 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010877 Sep 26 05:52:28.552570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 401/813] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Sep 26 05:52:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 26 05:52:28.559914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2a05f5e0-e298-4cef-90c0-326c46d7fe78 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Action: 'create', calling method: .version_select at 0x7f1e5e343040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-479601139", "metadata": {"Type": "work"}}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2a05f5e0-e298-4cef-90c0-326c46d7fe78 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Request method failure captured: Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 118 Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT4cpipBzvDRc4I4Uuki6F2st6yogdtqcfK3KJuUcp-kp2FxPLQDso1j0C2vHa1nrE3aXQNEcVnN_ZmzBsUIk3jfuio02cGDqhvyAeLaNcWu9P0jksw155_-2XaRgCBzIK1X96tE0amNVdPRSBuvuf8-0KZfc0vyxmYGswunWJC6DoU Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:28.563553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_15d8f644bc9342379a8c6007f00aa363", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 09f95547d1a04222a7965b83918905aa Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-479601139", "metadata": {"Type": "work"}}} Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:52:28.564931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-479601139', 'metadata': {'Type': 'work'}}}} Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise error Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi '' Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:28.566016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 05:52:28.567740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 05:52:28.569185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 05:52:28.569185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.569185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2a05f5e0-e298-4cef-90c0-326c46d7fe78 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:28.569185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2a05f5e0-e298-4cef-90c0-326c46d7fe78 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009451 Sep 26 05:52:28.569185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 402/814] 10.222.0.57 () {60 vars in 1156 bytes} [Mon Sep 26 05:52:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:52:28.575000 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d07e2332-9d3d-4088-9a7f-6b3bfd2efb9a tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Calling method '.version_select at 0x7f1e5e2bbb80>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:28.605835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-d07e2332-9d3d-4088-9a7f-6b3bfd2efb9a tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] HTTP exception thrown: Volume tempest-invalid-135051138 could not be found. Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d07e2332-9d3d-4088-9a7f-6b3bfd2efb9a tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Request method failure captured: Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-135051138 HTTP/1.1 Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT4cpipBzvDRc4I4Uuki6F2st6yogdtqcfK3KJuUcp-kp2FxPLQDso1j0C2vHa1nrE3aXQNEcVnN_ZmzBsUIk3jfuio02cGDqhvyAeLaNcWu9P0jksw155_-2XaRgCBzIK1X96tE0amNVdPRSBuvuf8-0KZfc0vyxmYGswunWJC6DoU Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:28.607684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_15d8f644bc9342379a8c6007f00aa363", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 09f95547d1a04222a7965b83918905aa Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Volume tempest-invalid-135051138 could not be found. Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'tempest-invalid-135051138'} Sep 26 05:52:28.609195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-135051138 could not be found. (HTTP 404) (Request-ID: req-523d484f-40d7-4a4b-9fa9-a60f155b15ed) Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.610216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:52:28.611523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-135051138 could not be found. Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:28.612803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-135051138 could not be found. Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-135051138 could not be found. Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d07e2332-9d3d-4088-9a7f-6b3bfd2efb9a tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Returning 404 to user: Volume tempest-invalid-135051138 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d07e2332-9d3d-4088-9a7f-6b3bfd2efb9a tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-135051138" status: 404 len: 98 microversion: 2.1 time: 0.038114 Sep 26 05:52:28.614079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 403/815] 10.222.0.57 () {58 vars in 1215 bytes} [Mon Sep 26 05:52:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-135051138 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 26 05:52:28.619975 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-834ade3a-898d-4ac8-b549-97ff170cea2e tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003732 Sep 26 05:52:28.620672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 404/816] 10.222.0.57 () {58 vars in 1140 bytes} [Mon Sep 26 05:52:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 05:52:28.629872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-160208ef-9b69-40cd-9a49-02779a8b7b64 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003776 Sep 26 05:52:28.630645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 405/817] 10.222.0.57 () {58 vars in 1137 bytes} [Mon Sep 26 05:52:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 05:52:28.640986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ea57207c-d725-4daa-abba-09c48dc9e772 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Calling method '.version_select at 0x7f1e5e2f63a0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:28.670229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:28.674068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-ea57207c-d725-4daa-abba-09c48dc9e772 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] HTTP exception thrown: Volume 5af7aedb-a847-4904-99e8-e1b4e0743515 could not be found. Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ea57207c-d725-4daa-abba-09c48dc9e772 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Request method failure captured: Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/os-volumes/5af7aedb-a847-4904-99e8-e1b4e0743515 HTTP/1.1 Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT4cpipBzvDRc4I4Uuki6F2st6yogdtqcfK3KJuUcp-kp2FxPLQDso1j0C2vHa1nrE3aXQNEcVnN_ZmzBsUIk3jfuio02cGDqhvyAeLaNcWu9P0jksw155_-2XaRgCBzIK1X96tE0amNVdPRSBuvuf8-0KZfc0vyxmYGswunWJC6DoU Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:28.676034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_15d8f644bc9342379a8c6007f00aa363", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 09f95547d1a04222a7965b83918905aa Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Volume 5af7aedb-a847-4904-99e8-e1b4e0743515 could not be found. Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '5af7aedb-a847-4904-99e8-e1b4e0743515'} Sep 26 05:52:28.677743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5af7aedb-a847-4904-99e8-e1b4e0743515 could not be found. (HTTP 404) (Request-ID: req-1460ce5f-40e5-444b-9a7b-51d629cb218e) Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.679544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:52:28.680847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5af7aedb-a847-4904-99e8-e1b4e0743515 could not be found. Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 05:52:28.682160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5af7aedb-a847-4904-99e8-e1b4e0743515 could not be found. Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5af7aedb-a847-4904-99e8-e1b4e0743515 could not be found. Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ea57207c-d725-4daa-abba-09c48dc9e772 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Returning 404 to user: Volume 5af7aedb-a847-4904-99e8-e1b4e0743515 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:28.683762 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ea57207c-d725-4daa-abba-09c48dc9e772 tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/5af7aedb-a847-4904-99e8-e1b4e0743515" status: 404 len: 109 microversion: 2.1 time: 0.041087 Sep 26 05:52:28.684753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-401cf746-9e98-4ee5-8733-8b5fc4ac6add tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1550 microversion: 2.1 time: 0.175467 Sep 26 05:52:28.684850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 406/818] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:52:28 2022] DELETE /compute/v2.1/os-volumes/5af7aedb-a847-4904-99e8-e1b4e0743515 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:52:28.684937 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 413/819] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:28 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:28.689863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a5bdec80-9e1e-4c9e-a3fe-1dbdb1f971dc tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Calling method '.version_select at 0x7f1e5e2f6160>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:28.700715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:28.701226 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:28.707333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.707811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.708232 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.708913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:28.709382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:28.709789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:28.718742 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-a5bdec80-9e1e-4c9e-a3fe-1dbdb1f971dc tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] HTTP exception thrown: Volume 5062931e-befd-4bf4-8926-a65fefd72531 could not be found. Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a5bdec80-9e1e-4c9e-a3fe-1dbdb1f971dc tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Request method failure captured: Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/os-volumes/5062931e-befd-4bf4-8926-a65fefd72531 HTTP/1.1 Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT4cpipBzvDRc4I4Uuki6F2st6yogdtqcfK3KJuUcp-kp2FxPLQDso1j0C2vHa1nrE3aXQNEcVnN_ZmzBsUIk3jfuio02cGDqhvyAeLaNcWu9P0jksw155_-2XaRgCBzIK1X96tE0amNVdPRSBuvuf8-0KZfc0vyxmYGswunWJC6DoU Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:28.720673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/15d8f644bc9342379a8c6007f00aa363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_15d8f644bc9342379a8c6007f00aa363", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 15d8f644bc9342379a8c6007f00aa363 Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesNegativeTest-1878877445 Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 09f95547d1a04222a7965b83918905aa Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesNegativeTest-1878877445-project Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Volume 5062931e-befd-4bf4-8926-a65fefd72531 could not be found. Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '5062931e-befd-4bf4-8926-a65fefd72531'} Sep 26 05:52:28.722275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5062931e-befd-4bf4-8926-a65fefd72531 could not be found. (HTTP 404) (Request-ID: req-821a2905-7307-48d7-a1c7-8fb80b9a4d07) Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.723387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:52:28.724761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5062931e-befd-4bf4-8926-a65fefd72531 could not be found. Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:52:28.726184 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5062931e-befd-4bf4-8926-a65fefd72531 could not be found. Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5062931e-befd-4bf4-8926-a65fefd72531 could not be found. Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a5bdec80-9e1e-4c9e-a3fe-1dbdb1f971dc tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] Returning 404 to user: Volume 5062931e-befd-4bf4-8926-a65fefd72531 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a5bdec80-9e1e-4c9e-a3fe-1dbdb1f971dc tempest-VolumesNegativeTest-1878877445 tempest-VolumesNegativeTest-1878877445-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/5062931e-befd-4bf4-8926-a65fefd72531" status: 404 len: 109 microversion: 2.1 time: 0.036864 Sep 26 05:52:28.727566 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 407/820] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:52:28 2022] GET /compute/v2.1/os-volumes/5062931e-befd-4bf4-8926-a65fefd72531 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:52:28.800978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0663b24a-4b23-412b-98b2-12f9ad455807 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104544 Sep 26 05:52:28.801660 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 414/821] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:52:28 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:52:29.526278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:29.527588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:29.534812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:29.535647 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:29.536403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:29.537110 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:29.537923 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:29.538916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:29.698157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:29.711067 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0ca06ab5-7574-4dc0-8375-25e12b798cbc tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1555 microversion: 2.1 time: 0.190111 Sep 26 05:52:29.712011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 408/822] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:29 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1555 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:29.842497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-fa78afd5-6ab1-4111-ba03-525fe72570b9 req-d83101e6-45eb-4b2e-896e-0d8339b4ba1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d8c38d1-af64-4696-bdab-e85587332b6e", "tag": "75b4cfd2-89be-4ea3-90ab-3906f010564d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:29.853507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-fa78afd5-6ab1-4111-ba03-525fe72570b9 req-d83101e6-45eb-4b2e-896e-0d8339b4ba1b service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:29.854270 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-fa78afd5-6ab1-4111-ba03-525fe72570b9 req-d83101e6-45eb-4b2e-896e-0d8339b4ba1b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:29.854697 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-fa78afd5-6ab1-4111-ba03-525fe72570b9 req-d83101e6-45eb-4b2e-896e-0d8339b4ba1b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:29.869422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-fa78afd5-6ab1-4111-ba03-525fe72570b9 req-d83101e6-45eb-4b2e-896e-0d8339b4ba1b service nova] Creating event network-changed:75b4cfd2-89be-4ea3-90ab-3906f010564d for instance 7d8c38d1-af64-4696-bdab-e85587332b6e on hv-cinder-83608 Sep 26 05:52:29.875569 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-fa78afd5-6ab1-4111-ba03-525fe72570b9 req-d83101e6-45eb-4b2e-896e-0d8339b4ba1b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037676 Sep 26 05:52:29.876354 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 415/823] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:30.737872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:30.739412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:30.750009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:30.750542 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:30.751220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:30.751889 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:30.752355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:30.752780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:31.134484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cab2568112f46bca576f17916887aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b095f1ee00e46cfabebc2dc34992997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:52:31.162103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3a1f57e0-807b-40fa-913d-e396ab3f98b5 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 200 len: 1555 microversion: 2.1 time: 0.429192 Sep 26 05:52:31.163756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 409/824] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:30 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 1555 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:52:31.424522 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-8c431e4f-fab3-4226-a5d4-828d8c6922e1 req-2eb39725-0a0a-4d3d-8093-07fef79fdef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700b7726-3a5c-412e-973f-02740f96edde", "name": "network-vif-deleted", "tag": "cfc17f70-ed8d-4384-a96d-8f2f72a15f6d"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:52:31.437224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-8c431e4f-fab3-4226-a5d4-828d8c6922e1 req-2eb39725-0a0a-4d3d-8093-07fef79fdef9 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:31.437702 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-8c431e4f-fab3-4226-a5d4-828d8c6922e1 req-2eb39725-0a0a-4d3d-8093-07fef79fdef9 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:31.438127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-8c431e4f-fab3-4226-a5d4-828d8c6922e1 req-2eb39725-0a0a-4d3d-8093-07fef79fdef9 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:31.444222 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:31.455620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-8c431e4f-fab3-4226-a5d4-828d8c6922e1 req-2eb39725-0a0a-4d3d-8093-07fef79fdef9 service nova] Creating event network-vif-deleted:cfc17f70-ed8d-4384-a96d-8f2f72a15f6d for instance 700b7726-3a5c-412e-973f-02740f96edde on hv-cinder-83608 Sep 26 05:52:31.463505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-8c431e4f-fab3-4226-a5d4-828d8c6922e1 req-2eb39725-0a0a-4d3d-8093-07fef79fdef9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042954 Sep 26 05:52:31.464337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 416/825] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:52:32.191867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:32.192589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] [instance: 700b7726-3a5c-412e-973f-02740f96edde] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:52:32.200016 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:32.200571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:32.201001 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:32.201742 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:52:32.202230 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:52:32.202649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:52:32.218696 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] HTTP exception thrown: Instance 700b7726-3a5c-412e-973f-02740f96edde could not be found. Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Request method failure captured: Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde HTTP/1.1 Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT0KLk-RoEzYXIu9cK4BfNgL9PV1kjo0laMZcTKv9eIZYIJFMKsCWU1Qt8zqbEAaxCg9plfmFICeBqq-G4pUMUGETqOqNxP7Ok7Di-otes9-p_bj93J6f8e7Q4ktE3U8D8vxyEa7pS9QnSk2JOxvcci9KDefxJTOTwr0LEQ1RxxIVok Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 0b095f1ee00e46cfabebc2dc34992997 Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-TestMinimumBasicScenario-250193205 Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:52:32.220165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0b095f1ee00e46cfabebc2dc34992997"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0b095f1ee00e46cfabebc2dc34992997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0b095f1ee00e46cfabebc2dc34992997"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0b095f1ee00e46cfabebc2dc34992997", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-TestMinimumBasicScenario-250193205 Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 0b095f1ee00e46cfabebc2dc34992997 Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-TestMinimumBasicScenario-250193205 Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-TestMinimumBasicScenario-250193205-project Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 3cab2568112f46bca576f17916887aa7 Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-TestMinimumBasicScenario-250193205-project Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 700b7726-3a5c-412e-973f-02740f96edde could not be found. Sep 26 05:52:32.221854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '700b7726-3a5c-412e-973f-02740f96edde'} Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 700b7726-3a5c-412e-973f-02740f96edde could not be found. Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:52:32.222695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 700b7726-3a5c-412e-973f-02740f96edde could not be found. Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 700b7726-3a5c-412e-973f-02740f96edde could not be found. Sep 26 05:52:32.223992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:52:32.225197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Returning 404 to user: Instance 700b7726-3a5c-412e-973f-02740f96edde could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:52:32.225197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-19b8796e-2d6a-4873-8d54-ec10dac43382 tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde" status: 404 len: 111 microversion: 2.1 time: 0.034100 Sep 26 05:52:32.225197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 410/826] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:52:32 2022] GET /compute/v2.1/servers/700b7726-3a5c-412e-973f-02740f96edde => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:52:32.234062 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e3b95b98-71f2-4e9d-92ee-78c6328e931f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] Calling method '.version_select at 0x7f1e5e48dee0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:52:32.255874 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e3b95b98-71f2-4e9d-92ee-78c6328e931f tempest-TestMinimumBasicScenario-250193205 tempest-TestMinimumBasicScenario-250193205-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1326552618" status: 202 len: 0 microversion: 2.1 time: 0.028927 Sep 26 05:52:32.256510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 417/827] 10.222.0.57 () {58 vars in 1272 bytes} [Mon Sep 26 05:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1326552618 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:53:39.096315 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:39.097318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:39.102913 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:39.103571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:39.113719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:39.114275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:39.114826 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:39.115648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:39.116201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:39.116749 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:39.145199 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fd67480a-3a2b-42a0-a112-ae489523f41f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/ips" status: 200 len: 151 microversion: 2.20 time: 0.051049 Sep 26 05:53:39.145781 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 411/828] 10.222.0.57 () {60 vars in 1289 bytes} [Mon Sep 26 05:53:39 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 05:53:41.092519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:41.098060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:53:41.098687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:41.106123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:41.106611 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:41.107047 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:41.107736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:41.108187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:41.108716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:41.132453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lazy-loading 'flavor' on Instance uuid 8953bd1b-2a0e-4f90-8177-08638164cf69 {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:53:41.339919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9da87f4b-1af9-48e2-87de-01bf7565dff9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/action" status: 202 len: 0 microversion: 2.20 time: 0.249227 Sep 26 05:53:41.340501 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 418/829] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Sep 26 05:53:41 2022] POST /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:53:41.349842 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:41.350600 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:41.358066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:41.358600 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:41.359181 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:41.359957 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:41.361113 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:41.361571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:41.501405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:41.510914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:41.512472 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:41.514118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-26561a56-0e1f-48e0-8b6a-e49da5526991 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.168271 Sep 26 05:53:41.515047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 412/830] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:41 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:41.835389 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:41.835969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:41.842903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:41.843383 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:41.843805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:41.844495 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:41.844964 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:41.845407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:41.871977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9ff19cb2-8655-4962-a0e7-755541fff5f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/ips" status: 200 len: 147 microversion: 2.1 time: 0.041195 Sep 26 05:53:41.872514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 419/831] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:53:41 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:53:42.544014 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:42.544579 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:42.552368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:42.552862 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:42.553336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:42.554041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:42.554501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:42.554945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:42.697919 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:42.706934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:42.708369 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:42.709939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4501ba4b-f21c-486b-a273-6fa24353bf4a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.170074 Sep 26 05:53:42.710494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 413/832] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:42 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:43.235090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:53:43.237528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:43.244172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:43.244653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:43.245084 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:43.245805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:43.246253 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:43.246693 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:43.523362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-543d1236-65a3-49b4-8e65-cbd9c561ccc8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292346 Sep 26 05:53:43.524149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 420/833] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:53:43 2022] POST /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:53:43.737162 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:43.737766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:43.745772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:43.746265 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:43.746690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:43.747400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:43.747860 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:43.748269 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:43.891517 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:43.901554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:43.903070 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:43.904267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6fbb1208-9169-4ef1-ad9e-e3b2739173f3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.172000 Sep 26 05:53:43.904801 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 414/834] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:43 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:44.931044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:44.931620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:44.938649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:44.939113 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:44.939564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:44.940210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:44.940676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:44.941084 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:45.093982 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:45.106056 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:45.107818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:45.109381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5de31061-86fd-44ba-ac55-bc167eb4a9aa tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.182693 Sep 26 05:53:45.109955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 421/835] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:44 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:46.138679 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:46.139804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:46.150887 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:46.151618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:46.152285 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:46.153597 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:46.154436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:46.155197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:46.305814 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:46.314738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:46.316205 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:46.317445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0928fb8d-1ad8-4d6e-a210-5428c2b25f23 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.185912 Sep 26 05:53:46.318011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 415/836] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:46 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:47.344531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:47.345178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:47.352139 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:47.352393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:47.352849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:47.353878 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:47.354018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:47.354440 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:47.492196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:47.500727 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:47.502173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:47.503329 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-676875d5-604b-40e2-8003-6476aab27d52 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.162941 Sep 26 05:53:47.503851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 422/837] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:47 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:48.530357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:48.530933 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:48.537840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:48.538342 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:48.538774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:48.539505 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:48.539959 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:48.540361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:48.706105 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:48.715877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:48.717425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:48.718857 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c9af9fba-d215-4405-86d6-659590330ece tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.192555 Sep 26 05:53:48.719434 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 416/838] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:48 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:49.748590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:49.749515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:49.756035 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:49.756487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:49.756937 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:49.757655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:49.758094 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:49.758629 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:49.900154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:49.911650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:49.913114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:49.914407 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-01706408-d94e-455c-9868-400019237aba tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.172289 Sep 26 05:53:49.914994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 423/839] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:49 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:50.941309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:50.941898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:50.949166 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:50.949712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:50.950201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:50.951005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:50.951485 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:50.951902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:51.111421 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:51.123153 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:51.125480 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:51.127069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-73a45890-9064-4701-8d20-42eb7fba29f0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.190068 Sep 26 05:53:51.127859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 417/840] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:50 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:53:51.166938 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:53:51.169423 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:51.176527 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:51.177013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:51.177469 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:51.178168 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:51.178623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:51.179042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:51.275993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Invalid volume: volume 7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f is already attached to instances: 430ecb3c-5a38-48a6-8054-84029ce9705e Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: POST /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments HTTP/1.1 Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 74 Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:53:51.277925 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {"volumeAttachment": {"volumeId": "7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f"}} Sep 26 05:53:51.284234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Invalid volume: volume 7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f is already attached to instances: 430ecb3c-5a38-48a6-8054-84029ce9705e Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'server_id': '430ecb3c-5a38-48a6-8054-84029ce9705e', 'body': {'volumeAttachment': {'volumeId': '7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f'}}} Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f is already attached to instances: 430ecb3c-5a38-48a6-8054-84029ce9705e Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:53:51.285331 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f is already attached to instances: 430ecb3c-5a38-48a6-8054-84029ce9705e Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:53:51.287097 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f is already attached to instances: 430ecb3c-5a38-48a6-8054-84029ce9705e Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 400 to user: Invalid volume: volume 7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f is already attached to instances: 430ecb3c-5a38-48a6-8054-84029ce9705e {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-39b7432e-55f0-441d-bcff-a235eb58a336 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.116597 Sep 26 05:53:51.289511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 424/841] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:53:51 2022] POST /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:53:51.354911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:51.355417 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:51.362310 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:51.362813 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:51.363283 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:51.364033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:51.364509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:51.364973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:51.475097 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lazy-loading 'services' on Instance uuid 430ecb3c-5a38-48a6-8054-84029ce9705e {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:53:51.567255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b88d6008-adf6-41b0-a187-7016dbb600dd tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments/7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f" status: 202 len: 0 microversion: 2.1 time: 0.216404 Sep 26 05:53:51.568038 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 418/842] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:53:51 2022] DELETE /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments/7142e0e1-4cb8-45c6-bfcd-0cd3495cda8f => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:53:51.580687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:51.584920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:51.594775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:51.595638 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:51.596647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:51.597552 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:51.598206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:51.598741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:51.633075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9b9a7692-3199-4e1a-acfe-058ff0c69615 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059644 Sep 26 05:53:51.633668 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 425/843] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:53:51 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:53:52.167854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:52.168645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:52.175917 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.176406 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.176916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:52.177583 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.178038 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.178453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:52.320494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:52.329710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:52.331201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:52.332366 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-18224e9b-2a1b-4467-b0c3-b6c8649aef87 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.169880 Sep 26 05:53:52.332916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 419/844] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:52 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:52.647316 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:52.649554 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:52.657885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.658368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.658809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:52.659482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.659928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.660351 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:52.693854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3571c6d9-4fb4-4576-acd5-ba1c089f98a1 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050674 Sep 26 05:53:52.695163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 426/845] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:53:52 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:53:52.781076 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:52.781674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:52.789575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.790403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.791228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:52.792379 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.793118 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.793779 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:52.823319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:53:52.908642 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e11c60ea-c171-4e40-b4c0-7ec7a4678eb9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 204 len: 0 microversion: 2.1 time: 0.134535 Sep 26 05:53:52.909312 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 420/846] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:53:52 2022] DELETE /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:53:52.920434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:52.921597 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:52.927778 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.928260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.928692 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:52.929416 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:52.929869 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:52.930287 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:53.079761 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:53.091980 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-84cf725d-bd72-4082-a917-5b400d85d7f0 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1679 microversion: 2.1 time: 0.177433 Sep 26 05:53:53.092709 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 427/847] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:53:52 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:53:53.359836 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:53.360496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:53.367662 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:53.368152 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:53.368589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:53.369348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:53.369818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:53.370280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:53.515577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:53.524717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:53.526492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:53.527896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-efb22cec-5797-4906-8fd3-0dbc0cbdda8f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.173105 Sep 26 05:53:53.529589 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 421/848] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:53 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:53:54.119621 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:54.120695 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:54.128045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:54.128547 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:54.128998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:54.129734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:54.130195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:54.130704 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:54.277492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:54.287497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-bf8e07ea-042e-47d5-af44-c64db27cc9a3 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1679 microversion: 2.1 time: 0.173603 Sep 26 05:53:54.288192 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 428/849] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:53:54 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:53:54.562135 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:54.562761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:54.570648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:54.571122 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:54.571553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:54.572238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:54.572682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:54.573127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:54.722180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:54.731398 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:54.732850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:54.734170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7088ade8-395c-438f-aa5d-978be26090b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.176185 Sep 26 05:53:54.734744 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 422/850] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:54 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:55.318572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:55.319321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:55.327455 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:55.327973 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:55.328409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:55.329125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:55.329606 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:55.329999 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:55.497190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:55.505598 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1ebf5a16-7c6f-408b-a299-3a36fba6f0c4 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 200 len: 1679 microversion: 2.1 time: 0.191892 Sep 26 05:53:55.506217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 429/851] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:53:55 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:53:55.768313 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-f3460070-4e67-43ef-9d2d-43d8bccbf182 req-26f65048-2269-47bb-a533-e8aafa370980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430ecb3c-5a38-48a6-8054-84029ce9705e", "name": "network-vif-deleted", "tag": "1a37892d-e555-40b3-af75-2110c6c4fd34"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:53:55.779762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:55.780672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:55.786732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-f3460070-4e67-43ef-9d2d-43d8bccbf182 req-26f65048-2269-47bb-a533-e8aafa370980 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:55.787536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-f3460070-4e67-43ef-9d2d-43d8bccbf182 req-26f65048-2269-47bb-a533-e8aafa370980 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:55.788139 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-f3460070-4e67-43ef-9d2d-43d8bccbf182 req-26f65048-2269-47bb-a533-e8aafa370980 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:55.792034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:55.792797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:55.794076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:55.797116 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:55.801075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:55.802099 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:55.813440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-f3460070-4e67-43ef-9d2d-43d8bccbf182 req-26f65048-2269-47bb-a533-e8aafa370980 service nova] Creating event network-vif-deleted:1a37892d-e555-40b3-af75-2110c6c4fd34 for instance 430ecb3c-5a38-48a6-8054-84029ce9705e on hv-cinder-83608 Sep 26 05:53:55.821991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-f3460070-4e67-43ef-9d2d-43d8bccbf182 req-26f65048-2269-47bb-a533-e8aafa370980 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059177 Sep 26 05:53:55.823392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 423/852] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:53:56.005102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:56.023764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:56.033461 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:56.036247 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-853809ca-1af1-482f-812a-985d116de858 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.264596 Sep 26 05:53:56.054078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 430/853] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:55 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:56.534774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:56.535978 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:56.545317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:56.545923 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:56.546621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:56.547445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:56.548000 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:56.548504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:56.563939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e HTTP/1.1 Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:53:56.565703 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:53:56.567420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '430ecb3c-5a38-48a6-8054-84029ce9705e'} Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:53:56.568465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:53:56.570624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:53:56.572019 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:53:56.572019 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dab6fae3-a64d-40fe-b4ae-7900a8e46d74 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 404 len: 111 microversion: 2.1 time: 0.040702 Sep 26 05:53:56.572019 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 424/854] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:53:56 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:53:56.581057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-98b8ce87-1fb9-4a09-9eec-f9ecd70f71f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '.version_select at 0x7f1e5e43c700>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:56.609891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-98b8ce87-1fb9-4a09-9eec-f9ecd70f71f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230459918" status: 202 len: 0 microversion: 2.1 time: 0.036329 Sep 26 05:53:56.610531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 431/855] 10.222.0.57 () {58 vars in 1221 bytes} [Mon Sep 26 05:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230459918 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:53:57.086022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:57.086850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:57.094071 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:57.094851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:57.095284 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:57.096021 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:57.096513 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:57.096939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:57.306196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:57.315179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:57.316641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:57.317890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ffbc1da1-328b-425a-88d8-666a701b5c62 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.237406 Sep 26 05:53:57.318492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 425/856] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:57 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:57.479809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fa245db9-f7f4-45c8-b9ce-97b5632aac8e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: .version_select at 0x7f1e5e3b20d0>, body: {"keypair": {"name": "tempest-keypair-1011680433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGt1XKVl02cMHbpTwAYzjTZtc+OrtVaE5vpAgpyMPGSgPk/imrU1sUQ0xjzS8cyr5KxExCakyhSw3+VsVEtrrAePXals8jEhFrQ6Mz/da5VlC1/62hQtKIX7VjlDWCb4Ig=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:53:57.496951 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-fa245db9-f7f4-45c8-b9ce-97b5632aac8e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:53:57.501168 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-fa245db9-f7f4-45c8-b9ce-97b5632aac8e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:53:57.527001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fa245db9-f7f4-45c8-b9ce-97b5632aac8e tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051088 Sep 26 05:53:57.527619 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 432/857] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:53:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:53:58.344212 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:58.344855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:58.351740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:58.352259 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:58.352674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:58.353405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:58.353862 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:58.354280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:58.563302 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:58.567625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:58.574269 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:58.575745 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:58.576927 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-72fd10f2-5a1c-45c3-9001-f70c2cc915d1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.236884 Sep 26 05:53:58.589163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 426/858] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:58 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:59.214245 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1794828962", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f147de2c-29b4-4f2b-a870-47c60a471f05"}], "security_groups": [{"name": "tempest-securitygroup--2061194879"}], "key_name": "tempest-keypair-1011680433", "user_data": "}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:53:59.324635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] validate_networks() for [('f147de2c-29b4-4f2b-a870-47c60a471f05', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:53:59.603896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:59.604586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:59.612372 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:59.612864 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:59.613327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:59.614033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:59.614487 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:59.614909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:59.717976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:53:59.718608 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:53:59.719157 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:53:59.719575 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:53:59.720008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:53:59.729991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:59.730622 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:59.731051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:59.731977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:53:59.732425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:53:59.732837 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:53:59.751732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:53:59.756051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Getting quotas for user bfaf6a2b8a2348b4aa603cda5fe624f5 and project 3fa25d71f2194e638989c1e1d9ef30da. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:53:59.760771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:59.768997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:53:59.769820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:59.771323 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:59.772603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3ce4e7e2-46ae-41d7-9ead-96dcc9cabfc9 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.172677 Sep 26 05:53:59.773266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 427/859] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:53:59 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:53:59.777730 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:53:59.832529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-910bd245-aaa4-4fa2-9098-53fe37743b39 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622653 Sep 26 05:53:59.833538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 433/860] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:53:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:53:59.845477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9521808c-a61f-48d5-bed4-c34acb536c3d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:53:59.846064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9521808c-a61f-48d5-bed4-c34acb536c3d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:53:59.903072 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9521808c-a61f-48d5-bed4-c34acb536c3d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:53:59.910705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9521808c-a61f-48d5-bed4-c34acb536c3d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1242 microversion: 2.1 time: 0.069392 Sep 26 05:53:59.911285 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 428/861] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:53:59 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:00.405874 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:00.406487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:00.412808 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:00.413350 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:00.413721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:00.414466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:00.414982 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:00.415405 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:00.420047 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:00.440807 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2b3aeeeb-1ddb-4a60-91ef-5db96217a12a tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/ips" status: 200 len: 145 microversion: 2.1 time: 0.039291 Sep 26 05:54:00.441488 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 434/862] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:54:00 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:00.804025 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:00.804649 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:00.812645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:00.813176 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:00.813618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:00.814321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:00.814776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:00.815256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:00.934569 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:00.935185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:00.941951 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:00.942445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:00.942885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:00.943593 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:00.944029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:00.944444 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:00.958404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:00.967888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:00.969651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:00.971364 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1a2a2a4a-6ef3-4fe3-b415-bb2bc0c2d0e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.176071 Sep 26 05:54:00.971949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 429/863] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:00 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:01.023312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:01.032450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f88ef99d-68ba-44d8-a96a-16a2bda2765f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1294 microversion: 2.1 time: 0.101838 Sep 26 05:54:01.033015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 435/864] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:00 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:01.998720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:01.999365 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:02.006411 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:02.006893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:02.007316 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:02.007971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:02.008646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:02.009420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:02.057453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:02.058167 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:02.065457 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:02.066008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:02.066456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:02.067324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:02.067856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:02.068322 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:02.227041 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:02.230499 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:02.238208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-466aceda-89b4-4af5-891c-5aba110fa3d7 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.185969 Sep 26 05:54:02.239078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 436/865] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:02 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:02.242593 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:02.244425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:02.245934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-13541164-2462-464e-a99b-72d3703cb90b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.251291 Sep 26 05:54:02.246672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 430/866] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:01 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:54:02.611997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-96e8473c-81cd-4a4a-b10d-39b1dd9b23af req-30031e4c-ebb2-46b4-86e8-657d1eefcb48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168ae322-faa2-4343-bee4-6312b82d0cbb", "tag": "bea9712c-9bb5-4df0-959b-0528f14cc976"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:02.622387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-96e8473c-81cd-4a4a-b10d-39b1dd9b23af req-30031e4c-ebb2-46b4-86e8-657d1eefcb48 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:02.622939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-96e8473c-81cd-4a4a-b10d-39b1dd9b23af req-30031e4c-ebb2-46b4-86e8-657d1eefcb48 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:02.623545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-96e8473c-81cd-4a4a-b10d-39b1dd9b23af req-30031e4c-ebb2-46b4-86e8-657d1eefcb48 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:02.635573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-96e8473c-81cd-4a4a-b10d-39b1dd9b23af req-30031e4c-ebb2-46b4-86e8-657d1eefcb48 service nova] Creating event network-changed:bea9712c-9bb5-4df0-959b-0528f14cc976 for instance 168ae322-faa2-4343-bee4-6312b82d0cbb on hv-cinder-83608 Sep 26 05:54:02.640719 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-96e8473c-81cd-4a4a-b10d-39b1dd9b23af req-30031e4c-ebb2-46b4-86e8-657d1eefcb48 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032426 Sep 26 05:54:02.641512 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 437/867] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:02.880764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02c3a3d8-6588-4d33-982f-b520f472b52b"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:02.883380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:02.889986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:02.890464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:02.890965 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:02.891667 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:02.892123 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:02.892543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:03.264459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:03.266634 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:03.280298 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:03.281065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:03.282196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:03.283591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:03.284564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:03.285328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:03.317739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6eeae0b8-b7cf-4fea-8d2e-9d9992612085 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440782 Sep 26 05:54:03.323869 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 431/868] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:54:02 2022] POST /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:03.347719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:03.349918 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:03.367221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:03.369603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:03.370290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:03.381025 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:03.383628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:03.384292 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:03.481157 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:03.489635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-effcaaa9-3c97-49d6-ac99-30b64989a02f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.230372 Sep 26 05:54:03.490213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 438/869] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:03 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:03.494834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-bdeb8fbd-65df-4af3-9356-1ec8e18e5f80 req-41981635-d016-4163-a07a-5f5a4608e8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8953bd1b-2a0e-4f90-8177-08638164cf69", "name": "network-vif-plugged", "status": "completed", "tag": "eab744db-21fb-4b22-8514-b8bf28f598a7"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:03.504449 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-bdeb8fbd-65df-4af3-9356-1ec8e18e5f80 req-41981635-d016-4163-a07a-5f5a4608e8da service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:03.504930 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-bdeb8fbd-65df-4af3-9356-1ec8e18e5f80 req-41981635-d016-4163-a07a-5f5a4608e8da service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:03.505385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-bdeb8fbd-65df-4af3-9356-1ec8e18e5f80 req-41981635-d016-4163-a07a-5f5a4608e8da service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:03.517286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-bdeb8fbd-65df-4af3-9356-1ec8e18e5f80 req-41981635-d016-4163-a07a-5f5a4608e8da service nova] Creating event network-vif-plugged:eab744db-21fb-4b22-8514-b8bf28f598a7 for instance 8953bd1b-2a0e-4f90-8177-08638164cf69 on hv-cinder-83608 Sep 26 05:54:03.522429 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-bdeb8fbd-65df-4af3-9356-1ec8e18e5f80 req-41981635-d016-4163-a07a-5f5a4608e8da service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031057 Sep 26 05:54:03.523029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 439/870] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:03.558256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:03.567847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:03.569376 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:03.571454 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-39e00468-adac-4a53-ba61-a26db038e473 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.251516 Sep 26 05:54:03.572283 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 432/871] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:03 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:04.513225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:04.513821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:04.520705 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:04.521182 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:04.521641 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:04.522333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:04.522763 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:04.523193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:04.601080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:04.601789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:04.608846 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:04.609368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:04.609810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:04.610518 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:04.610979 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:04.611484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:04.684309 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:04.692360 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-85051161-2134-430d-846f-55ddfd3f3c47 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.183958 Sep 26 05:54:04.693059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 440/872] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:04 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:04.760002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:04.769311 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:04.770668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:04.771843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-83dd4c85-7b43-498c-9721-4ceb64f6e70b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.175127 Sep 26 05:54:04.772395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 433/873] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:04 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:05.715970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:05.716634 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:05.723778 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:05.724266 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:05.724697 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:05.725430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:05.725884 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:05.726310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:05.797731 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:05.798292 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:05.804890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:05.805417 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:05.805853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:05.806558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:05.807018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:05.807439 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:05.864646 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:05.873263 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-61b78dd3-4d3d-4270-96f0-aa6f9b3f7944 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.161107 Sep 26 05:54:05.875405 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 441/874] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:05 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:05.942938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:05.951624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:05.953040 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:05.954352 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-614cd81a-cc57-4a5a-aaa4-56113c9b026f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.160644 Sep 26 05:54:05.954990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 434/875] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:05 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:06.897074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:06.897819 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:06.905393 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:06.905645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:06.906023 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:06.906781 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:06.907243 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:06.907928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:06.980254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:06.980894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:06.987625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:06.988105 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:06.988538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:06.989286 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:06.989740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:06.990155 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:07.049320 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:07.058457 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-76c79e4b-675d-47c4-bd8d-e06db26cb2fe tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.165735 Sep 26 05:54:07.058941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 442/876] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:06 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:07.341990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:07.351105 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:07.352544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:07.353758 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fa8d13ae-8a6c-4355-97d5-fcb8928cddb5 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1743 microversion: 2.20 time: 0.377380 Sep 26 05:54:07.354335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 435/877] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:06 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1743 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:54:08.082759 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:08.083882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:08.091559 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:08.091918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:08.092348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:08.093055 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:08.093542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:08.093964 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:08.241079 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:08.249564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-bd278550-3b72-4211-8e2a-d4e372a79b38 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.170493 Sep 26 05:54:08.250112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 443/878] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:08 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:08.386152 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:08.386774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:08.396533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:08.397050 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:08.397561 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:08.398413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:08.398880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:08.399308 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:08.569765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:08.580049 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:08.582297 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:08.583961 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-35f8d3f5-7502-4f93-9107-b2c99e847d17 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.208570 Sep 26 05:54:08.584797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 436/879] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:08 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:09.277127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:09.278500 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:09.299844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:09.300626 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:09.301294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:09.302277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:09.302899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:09.303891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:09.481687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:09.497390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-10db171e-8727-4c2c-be5f-6a13e2103f3a tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.224053 Sep 26 05:54:09.499088 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 444/880] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:09 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:54:09.613460 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:09.615723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:09.619233 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:09.626210 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:09.626706 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:09.627137 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:09.627903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:09.628382 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:09.628812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:09.804125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:09.814329 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:09.816309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:09.817971 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5219c154-5ee1-4a65-95df-0f02924d9f3c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.209452 Sep 26 05:54:09.819164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 437/881] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:09 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:10.535801 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:10.536468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:10.538567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:10.539238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=10 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:10.553779 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:10.554412 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:10.555074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:10.556139 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:10.556691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:10.557736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:10.801937 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:10.811889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-438e95c4-1783-43fe-8bc7-3004c5a4d16f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.280101 Sep 26 05:54:10.812909 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 445/882] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:10 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:10.844159 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:10.845485 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:10.851054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:10.853701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:10.854223 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:10.854666 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:10.855398 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:10.855857 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:10.856278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:11.037754 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:11.050500 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:11.052605 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:11.054019 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-686c5acb-256e-4729-83d7-b57f6ffb80ed tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.213975 Sep 26 05:54:11.055796 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 438/883] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:10 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:11.393747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-5e2b4e1e-7a2d-4bc4-aa81-38ceeee0ef0b req-5a5b56d6-e42d-4832-abbf-30186b6bcd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168ae322-faa2-4343-bee4-6312b82d0cbb", "name": "network-vif-plugged", "status": "completed", "tag": "bea9712c-9bb5-4df0-959b-0528f14cc976"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:11.403060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:11.415056 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-5e2b4e1e-7a2d-4bc4-aa81-38ceeee0ef0b req-5a5b56d6-e42d-4832-abbf-30186b6bcd9a service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:11.415551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-5e2b4e1e-7a2d-4bc4-aa81-38ceeee0ef0b req-5a5b56d6-e42d-4832-abbf-30186b6bcd9a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:11.415984 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-5e2b4e1e-7a2d-4bc4-aa81-38ceeee0ef0b req-5a5b56d6-e42d-4832-abbf-30186b6bcd9a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:11.443189 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-5e2b4e1e-7a2d-4bc4-aa81-38ceeee0ef0b req-5a5b56d6-e42d-4832-abbf-30186b6bcd9a service nova] Creating event network-vif-plugged:bea9712c-9bb5-4df0-959b-0528f14cc976 for instance 168ae322-faa2-4343-bee4-6312b82d0cbb on hv-cinder-83608 Sep 26 05:54:11.448685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-5e2b4e1e-7a2d-4bc4-aa81-38ceeee0ef0b req-5a5b56d6-e42d-4832-abbf-30186b6bcd9a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061584 Sep 26 05:54:11.449739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 446/884] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:54:11.837392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:11.838356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:11.850476 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:11.852054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:11.852653 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:11.853631 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:11.854413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:11.855058 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:12.062859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:12.074462 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-db6e90f7-2b17-4f70-962c-b67a5dc89af9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.242169 Sep 26 05:54:12.082530 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:12.084664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:12.089072 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 439/885] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:11 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:12.098378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:12.099189 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:12.099764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:12.100642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:12.101280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:12.102757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:12.263427 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:12.273038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:12.274569 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:12.275815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c06a96e8-bbd6-4e15-b811-245bdc115f48 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.198282 Sep 26 05:54:12.276468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 447/886] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:12 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:54:13.119129 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:13.121194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:13.147989 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:13.148821 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:13.149617 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:13.152994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:13.153621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:13.154141 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:13.302076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:13.303328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:13.311001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:13.312170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:13.312845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:13.313810 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:13.314481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:13.315102 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:13.361453 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:13.372984 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0f0b08da-2e0a-4091-8180-66dce2e30bf9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1368 microversion: 2.1 time: 0.261918 Sep 26 05:54:13.373707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 440/887] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:13 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:13.551386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:13.561997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:13.563929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:13.565484 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a185afcf-9f13-48d2-8fb9-d9770d1589e0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.267632 Sep 26 05:54:13.566648 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 448/888] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:13 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:54:14.401387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:14.401980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:14.409886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:14.410816 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:14.411537 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:14.412524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:14.413279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:14.413969 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:14.580151 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:14.590394 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e5168486-08b0-4e18-8a9b-e34e5b9ae306 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1557 microversion: 2.1 time: 0.195227 Sep 26 05:54:14.593037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 441/889] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:14 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1557 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:14.605660 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:14.607077 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:14.615970 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:14.616544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:14.616774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:14.617516 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:14.618182 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:14.619279 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:14.619969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:14.620463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:14.623291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:14.623890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:14.628313 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:14.630424 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:14.631249 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:14.632185 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:14.735253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bde32371-9a14-4155-8b05-b68e1a94e43d tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123359 Sep 26 05:54:14.743760 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 442/890] 10.222.0.57 () {58 vars in 1275 bytes} [Mon Sep 26 05:54:14 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:14.808375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:14.825658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:14.827601 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:14.829191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-86e58922-e316-493c-901c-d5b8d46d0a8c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.241152 Sep 26 05:54:14.830300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 449/891] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:14 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:54:15.477850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:15.480353 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:15.507505 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:15.508553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:15.509382 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:15.510730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:15.511481 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:15.512358 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:15.534051 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:15.551471 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9a54ab45-d408-420a-927e-37c48819999d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083918 Sep 26 05:54:15.552371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 443/892] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:54:15 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:15.563666 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:15.564165 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:15.572590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:15.573090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:15.574675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:15.576220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:15.576679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:15.577491 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:15.620285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-aebe9f24-21b4-4c68-86a2-55f50422c4ef tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/02c3a3d8-6588-4d33-982f-b520f472b52b" status: 200 len: 194 microversion: 2.1 time: 0.060509 Sep 26 05:54:15.623316 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 450/893] 10.222.0.57 () {58 vars in 1413 bytes} [Mon Sep 26 05:54:15 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/02c3a3d8-6588-4d33-982f-b520f472b52b => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:15.856904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:15.857844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:15.868416 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:15.869169 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:15.869859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:15.871013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:15.871672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:15.872473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:16.081510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-80733595-dc84-459f-a601-b427a0398020 req-20d45b9f-15d3-4865-92a2-c5385bea6aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168ae322-faa2-4343-bee4-6312b82d0cbb", "tag": "bea9712c-9bb5-4df0-959b-0528f14cc976"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:16.100174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-80733595-dc84-459f-a601-b427a0398020 req-20d45b9f-15d3-4865-92a2-c5385bea6aba service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:16.100644 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-80733595-dc84-459f-a601-b427a0398020 req-20d45b9f-15d3-4865-92a2-c5385bea6aba service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:16.102498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-80733595-dc84-459f-a601-b427a0398020 req-20d45b9f-15d3-4865-92a2-c5385bea6aba service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:16.122216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-80733595-dc84-459f-a601-b427a0398020 req-20d45b9f-15d3-4865-92a2-c5385bea6aba service nova] Creating event network-changed:bea9712c-9bb5-4df0-959b-0528f14cc976 for instance 168ae322-faa2-4343-bee4-6312b82d0cbb on hv-cinder-83608 Sep 26 05:54:16.134239 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-80733595-dc84-459f-a601-b427a0398020 req-20d45b9f-15d3-4865-92a2-c5385bea6aba service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057019 Sep 26 05:54:16.135202 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 451/894] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:54:16.156721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:16.169213 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:16.173656 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:16.176778 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-92ba45f1-792e-420a-b52e-7e7ba5057e0c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.324521 Sep 26 05:54:16.193170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 444/895] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:15 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:17.205873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:17.207305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:17.226245 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:17.227051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:17.227660 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:17.228912 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:17.230117 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:17.230696 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:17.248536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4936a9eb-222e-4b6d-8f2b-243781da312e"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:17.251327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:17.271421 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:17.272091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:17.272630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:17.273531 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:17.274190 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:17.274734 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:17.448961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:17.465675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:17.467481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:17.469310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3484ec59-8104-45c3-ad09-da8a8fbcebb1 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.268618 Sep 26 05:54:17.473552 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 452/896] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:17 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:17.882912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-939b09f5-08a9-41ae-ab8d-58bb957b0cbc tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "POST /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637644 Sep 26 05:54:17.883615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 445/897] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:54:17 2022] POST /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments => generated 194 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:54:18.500653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:18.502708 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:18.511450 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:18.512327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:18.513095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:18.514061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:18.518196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:18.518196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:18.681026 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:18.684793 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=100 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:18.690887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:18.692338 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:18.693561 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6f670398-0f11-4912-9954-11dac263d750 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1738 microversion: 2.20 time: 0.198278 Sep 26 05:54:18.694115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 453/898] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:18 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:19.721625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:19.722625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:19.730967 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:19.731466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:19.731899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:19.732613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:19.733080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:19.733522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:19.875387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:19.884400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:19.885940 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:19.887193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-923e28c3-9b71-492e-810b-842107c9448c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1720 microversion: 2.20 time: 0.171028 Sep 26 05:54:19.887771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 446/899] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:19 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:20.914410 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:20.915005 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:20.922314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:20.922818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:20.923252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:20.923977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:20.924545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:20.924968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:21.065563 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:21.075851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:21.077315 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:21.078482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-67aa4180-6db2-4517-9c98-41c1f68577b6 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1720 microversion: 2.20 time: 0.168141 Sep 26 05:54:21.079060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 454/900] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:20 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:22.105863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:22.106484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:22.113876 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:22.114354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:22.114781 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:22.115477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:22.115952 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:22.116394 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:22.264245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:22.272445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:22.273962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:22.275150 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8928185b-b931-4270-814c-85ac842141a2 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1720 microversion: 2.20 time: 0.173378 Sep 26 05:54:22.275719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 447/901] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:22 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:23.305964 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:23.306590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:23.314871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:23.315248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:23.315631 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:23.316341 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:23.316816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:23.317422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:23.438538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-02b51863-a985-42fd-b102-250df8f1dae6 req-97432e54-b38c-4283-8906-1f6a4d968f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8953bd1b-2a0e-4f90-8177-08638164cf69", "name": "network-vif-unplugged", "status": "completed", "tag": "eab744db-21fb-4b22-8514-b8bf28f598a7"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:23.449454 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-02b51863-a985-42fd-b102-250df8f1dae6 req-97432e54-b38c-4283-8906-1f6a4d968f41 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:23.449939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-02b51863-a985-42fd-b102-250df8f1dae6 req-97432e54-b38c-4283-8906-1f6a4d968f41 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:23.450368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-02b51863-a985-42fd-b102-250df8f1dae6 req-97432e54-b38c-4283-8906-1f6a4d968f41 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:23.451321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:23.462019 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:23.462746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.compute.server_external_events [req-02b51863-a985-42fd-b102-250df8f1dae6 req-97432e54-b38c-4283-8906-1f6a4d968f41 service nova] Unable to find a host for instance 8953bd1b-2a0e-4f90-8177-08638164cf69. Dropping event network-vif-unplugged {{(pid=127275) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 05:54:23.463542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:23.463673 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-02b51863-a985-42fd-b102-250df8f1dae6 req-97432e54-b38c-4283-8906-1f6a4d968f41 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029310 Sep 26 05:54:23.464387 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 448/902] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 26 05:54:23.464722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d0ef7647-bfc5-4f7b-8834-eba7b529d386 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1663 microversion: 2.20 time: 0.162716 Sep 26 05:54:23.465531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 455/903] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:23 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:23.489807 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7c2da96-76b6-43ee-a081-e8c7d9546bbd"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:23.492169 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:23.498336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:23.498825 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:23.499261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:23.499964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:23.500416 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:23.500844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:23.794653 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e352d210-ab05-4fe2-a501-7539e43ef6c4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308991 Sep 26 05:54:23.795265 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 449/904] 10.222.0.57 () {62 vars in 1364 bytes} [Mon Sep 26 05:54:23 2022] POST /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 05:54:23.925164 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:23.925657 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:23.931988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:23.932480 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:23.932906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:23.933644 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:23.934092 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:23.934505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:24.213072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3b30e69f-4527-496e-85c6-a18d1bec9568 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-volume_attachments/a7c2da96-76b6-43ee-a081-e8c7d9546bbd" status: 202 len: 0 microversion: 2.20 time: 0.291987 Sep 26 05:54:24.213795 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 456/905] 10.222.0.57 () {60 vars in 1457 bytes} [Mon Sep 26 05:54:23 2022] DELETE /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-volume_attachments/a7c2da96-76b6-43ee-a081-e8c7d9546bbd => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:54:24.278320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:24.278911 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:24.285221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:24.285710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:24.286131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:24.286803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:24.287244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:24.287654 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:24.333839 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127275) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 05:54:24.409645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ed583492-c95e-4d42-b6d4-d31fa4ba5e1a tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "POST /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/action" status: 202 len: 0 microversion: 2.20 time: 0.135344 Sep 26 05:54:24.410296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 450/906] 10.222.0.57 () {62 vars in 1319 bytes} [Mon Sep 26 05:54:24 2022] POST /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:54:24.420373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:24.420993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:24.429581 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:24.430145 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:24.430735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:24.431712 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:24.431909 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:24.432402 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:24.577253 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:24.586639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:24.588730 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:24.589970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-33553742-8453-4dca-b415-49706dd73d5e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1671 microversion: 2.20 time: 0.174551 Sep 26 05:54:24.590525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 457/907] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:24 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:25.599781 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:25.607412 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:25.608946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.609492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.609936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.610717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.611429 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.611874 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.616616 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:25.617460 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:25.624020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.624507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.624934 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.625774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.626221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.626639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.647559 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c58b08a7-1006-4c62-a43c-87612381e3ab tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054715 Sep 26 05:54:25.648790 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 451/908] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:54:25 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:54:25.759620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:25.769377 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:25.770862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:25.772032 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ed3a562b-a1e0-407a-a753-de98b531a971 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1673 microversion: 2.20 time: 0.159541 Sep 26 05:54:25.772587 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 458/909] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:25 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:25.787783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:25.788348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:25.794716 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.795211 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.795650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.796348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.796805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.797267 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.830784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7f491ea8-b977-49d0-b2d9-f589ee3e97bf tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/02c3a3d8-6588-4d33-982f-b520f472b52b" status: 200 len: 194 microversion: 2.1 time: 0.047133 Sep 26 05:54:25.831533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 452/910] 10.222.0.57 () {58 vars in 1413 bytes} [Mon Sep 26 05:54:25 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/02c3a3d8-6588-4d33-982f-b520f472b52b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:25.842824 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:25.843268 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:25.849323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.849806 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.850238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.850948 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:25.851397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:25.851813 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:25.933206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lazy-loading 'services' on Instance uuid 7d8c38d1-af64-4696-bdab-e85587332b6e {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:54:26.013180 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c9947dc5-93ff-491a-96ad-561d5796930c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/02c3a3d8-6588-4d33-982f-b520f472b52b" status: 202 len: 0 microversion: 2.1 time: 0.174105 Sep 26 05:54:26.013889 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 459/911] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:54:25 2022] DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/02c3a3d8-6588-4d33-982f-b520f472b52b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:54:26.945450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:26.946129 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:26.954825 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:26.955310 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:26.955776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:26.956580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:26.957033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:26.957486 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:27.195789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:27.204177 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:27.206859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:27.208426 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e4f6f124-b477-464f-b04f-9db692757741 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.412936 Sep 26 05:54:27.209014 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 453/912] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:26 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:28.218664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:28.219867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:28.226903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:28.227397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:28.227833 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:28.229344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:28.229344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:28.229765 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:28.241756 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:28.243054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:28.250064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:28.250891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:28.251536 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:28.252485 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:28.253418 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:28.254069 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:28.266580 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9ca4c791-62c9-4e41-ad55-a43236e99753 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/4936a9eb-222e-4b6d-8f2b-243781da312e" status: 200 len: 194 microversion: 2.1 time: 0.052980 Sep 26 05:54:28.267517 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 460/913] 10.222.0.57 () {58 vars in 1413 bytes} [Mon Sep 26 05:54:28 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/4936a9eb-222e-4b6d-8f2b-243781da312e => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:28.279565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:28.279565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:28.291294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:28.292190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:28.292753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:28.293804 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:28.294762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:28.296873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:28.398041 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lazy-loading 'services' on Instance uuid 7d8c38d1-af64-4696-bdab-e85587332b6e {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:54:28.427710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:28.439920 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:28.441465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:28.442854 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7d5bdb07-27ce-456c-bb89-77da7605069b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.212018 Sep 26 05:54:28.443573 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 454/914] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:28 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:54:28.491084 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-53f3b9e1-6f5e-421d-ae58-be43ab05423b tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/4936a9eb-222e-4b6d-8f2b-243781da312e" status: 202 len: 0 microversion: 2.1 time: 0.216530 Sep 26 05:54:28.492328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 461/915] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:54:28 2022] DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments/4936a9eb-222e-4b6d-8f2b-243781da312e => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:54:29.470689 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:29.471337 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:29.478614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:29.479603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:29.479820 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:29.480553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:29.481061 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:29.481549 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:29.660689 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:29.665191 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:29.672292 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:29.674095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:29.675721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-59947f2d-75f6-4532-ab30-690d4e6fd3dd tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.208998 Sep 26 05:54:29.676469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 455/916] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:29 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 05:54:30.703567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:30.704251 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:30.711625 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:30.712108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:30.712539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:30.713248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:30.713860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:30.714422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:30.864977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:30.873691 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:30.875138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:30.876328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1ddcfebf-3c84-4992-af4f-cfc2bccc1b6e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.177631 Sep 26 05:54:30.876886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 462/917] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:30 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:31.902252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:31.902891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:31.911255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:31.911729 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:31.912157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:31.912861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:31.913337 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:31.913755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:32.063363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:32.073120 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:32.074592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:32.075783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-853ebdf3-c6ec-4f12-b916-33d081de3dec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.177622 Sep 26 05:54:32.076543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 456/918] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:31 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:33.102583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:33.103213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:33.110595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:33.110960 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:33.111282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:33.112135 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:33.112576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:33.112986 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:33.254280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:33.264171 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:33.264636 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:33.265920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-03ea413a-edb1-406f-adfb-ade8f63e13d8 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.167514 Sep 26 05:54:33.269179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 463/919] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:33 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:34.291754 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:34.292348 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:34.299363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:34.299855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:34.300287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:34.301031 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:34.301469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:34.301888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:34.447130 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:34.455839 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:34.457397 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:34.459084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8c67ed11-706c-48b3-929b-cba240c40b94 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.171394 Sep 26 05:54:34.459843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 457/920] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:34 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:35.499131 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:35.499799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:35.506816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:35.507289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:35.507738 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:35.508424 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:35.508877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:35.509351 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:35.655053 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:35.664008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:35.665859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:35.667029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cbe6e266-628b-4208-b291-e47b118a63db tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.171960 Sep 26 05:54:35.667805 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 464/921] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:35 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:36.695519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:36.696262 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:36.703955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:36.704441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:36.704876 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:36.705626 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:36.706169 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:36.706627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:36.849156 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:36.857904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:36.859336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:36.860506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3f8bb8ca-d779-4ff5-a39f-1643a6be9c8d tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.171305 Sep 26 05:54:36.861059 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 458/922] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:36 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:37.886131 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:37.886702 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:37.893826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:37.894313 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:37.894743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:37.895539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:37.895874 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:37.896289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:38.039254 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:38.052014 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:38.054278 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:38.056029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-37a67bd3-0db6-4389-9418-edc76164af68 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.173558 Sep 26 05:54:38.056670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 465/923] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:37 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:39.086167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:39.086771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:39.093713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:39.094199 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:39.094628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:39.095320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:39.095770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:39.096193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:39.239218 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:39.248450 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:39.249922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:39.251087 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3baa6b20-7165-43ea-a8ea-c55b964a00d0 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.169399 Sep 26 05:54:39.251644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 459/924] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:39 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:40.276067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:40.276628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:40.283569 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:40.284057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:40.284481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:40.285171 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:40.285655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:40.286124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:40.422257 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:40.424624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:40.431599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:40.433027 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:40.434219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c630af18-2dba-4d55-932d-e92b4010d155 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.162161 Sep 26 05:54:40.434777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 466/925] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:40 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:41.460131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:41.460712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:41.463142 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:41.469032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:41.469551 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:41.470011 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:41.470707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:41.471158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:41.471575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:41.623001 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:41.634475 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:41.635920 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:41.637102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f67630ca-8d93-463d-a4fb-eda95e49861f tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.181441 Sep 26 05:54:41.637714 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 460/926] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:41 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:42.662639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:42.663301 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:42.665972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=42 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:42.672387 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:42.672896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:42.673401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:42.674108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:42.674650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:42.674985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:42.812734 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:42.821572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:42.823001 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:42.824199 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7c955cbb-7415-4cd0-b388-505ae0f5046c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.165443 Sep 26 05:54:42.824760 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 467/927] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:42 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:43.663690 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:43.666141 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:43.673512 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.674002 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.674466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:43.675174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.675632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.676055 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:43.709357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-21f6b296-70ac-4957-a611-8d0459c51485 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049578 Sep 26 05:54:43.710022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 461/928] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:54:43 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:54:43.841510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:43.843816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:43.849856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:43.850463 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:43.850666 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.851170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.851603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:43.852312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.852842 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.853207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:43.856927 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.857455 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.857888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:43.858594 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.859054 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.859570 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:43.895876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b0117740-5adc-4b43-8a7b-c01bdaf24b08 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058358 Sep 26 05:54:43.896867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 468/929] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:54:43 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:54:43.963359 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:43.963945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:43.970136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.970617 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.971054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:43.971755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:43.972207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:43.972625 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:44.002745 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:54:44.003519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:44.014055 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:44.015834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:44.017256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-456c8ca9-d1da-4c75-9899-d2be06b3f42e tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.171489 Sep 26 05:54:44.026976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 462/930] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:43 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:44.084589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f4d5886e-0ba7-4593-8422-1fda18da499d tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 204 len: 0 microversion: 2.1 time: 0.124912 Sep 26 05:54:44.085290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 469/931] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:54:43 2022] DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:54:44.094653 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:44.095392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:44.101612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:44.102193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:44.102746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:44.103592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:44.103950 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:44.104364 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:44.239473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:44.247815 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-df6dcaa7-b7d5-4d54-b10c-181b616edf79 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1674 microversion: 2.1 time: 0.157518 Sep 26 05:54:44.248445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 463/932] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:44 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:45.047899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:45.048897 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:45.056240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:45.056732 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:45.057190 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:45.057893 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:45.058362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:45.058779 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:45.205659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:45.214948 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:45.216420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:45.217885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8b1610d9-c6b8-453f-aa65-021ebb085306 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.175332 Sep 26 05:54:45.218434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 470/933] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:45 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:45.271842 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:45.272420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:45.279655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:45.280150 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:45.280582 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:45.281338 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:45.281793 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:45.282212 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:45.420425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:45.428455 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-891b796a-8ac5-4c9f-b5c0-365221bd394c tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1674 microversion: 2.1 time: 0.160760 Sep 26 05:54:45.429052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 464/934] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:45 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:45.517946 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ca460259-0165-4c6f-acb2-6fb025d30144 req-5cae972f-cc15-4aa7-ae64-2d89962a6cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8953bd1b-2a0e-4f90-8177-08638164cf69", "name": "network-vif-plugged", "status": "completed", "tag": "eab744db-21fb-4b22-8514-b8bf28f598a7"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:45.528327 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ca460259-0165-4c6f-acb2-6fb025d30144 req-5cae972f-cc15-4aa7-ae64-2d89962a6cb4 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:45.528814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ca460259-0165-4c6f-acb2-6fb025d30144 req-5cae972f-cc15-4aa7-ae64-2d89962a6cb4 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:45.529294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ca460259-0165-4c6f-acb2-6fb025d30144 req-5cae972f-cc15-4aa7-ae64-2d89962a6cb4 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:45.542166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ca460259-0165-4c6f-acb2-6fb025d30144 req-5cae972f-cc15-4aa7-ae64-2d89962a6cb4 service nova] Creating event network-vif-plugged:eab744db-21fb-4b22-8514-b8bf28f598a7 for instance 8953bd1b-2a0e-4f90-8177-08638164cf69 on hv-cinder-83608 Sep 26 05:54:45.547143 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ca460259-0165-4c6f-acb2-6fb025d30144 req-5cae972f-cc15-4aa7-ae64-2d89962a6cb4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Sep 26 05:54:45.547749 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 471/935] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:46.244562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:46.245216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:46.251909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:46.252374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:46.252799 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:46.253541 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:46.253992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:46.254395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:46.394636 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:46.403472 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:46.405005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:46.406228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3ce3c102-f9da-4c3f-bfc8-f0b18de68ba4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.165745 Sep 26 05:54:46.406795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 465/936] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:46 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:46.453579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:46.454270 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:46.461253 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:46.461741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:46.462159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:46.462855 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:46.463299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:46.463714 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:46.606248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:46.614573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-79cd7225-7631-4e0c-a8d3-11e03429d128 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1674 microversion: 2.1 time: 0.165604 Sep 26 05:54:46.615149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 472/937] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:46 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:47.432258 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:47.432863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:47.440068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:47.440552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:47.440992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:47.441741 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:47.442193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:47.442723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:47.638237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:47.638851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:47.645906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:47.646392 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:47.646813 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:47.647504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:47.647945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:47.648357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:47.656194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:47.665397 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:47.667243 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:47.668432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-eab46832-a2a1-4371-b6cf-4463965d05b7 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.240268 Sep 26 05:54:47.669207 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 466/938] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:47 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:47.799581 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c26eec9a5e841f8b760cc8cef309b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc5a928f77549839c85f3ab7e7e13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:47.808599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-641ad6cc-f46a-4635-b549-2c696deddcc5 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 200 len: 1674 microversion: 2.1 time: 0.174168 Sep 26 05:54:47.809234 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 473/939] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:47 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:54:48.051092 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-1f2004e7-3ba7-4e67-90c5-64cada9476e6 req-d2d02eb3-123b-4a1b-9a62-48c506ed442d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d8c38d1-af64-4696-bdab-e85587332b6e", "name": "network-vif-deleted", "tag": "75b4cfd2-89be-4ea3-90ab-3906f010564d"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:54:48.066916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-1f2004e7-3ba7-4e67-90c5-64cada9476e6 req-d2d02eb3-123b-4a1b-9a62-48c506ed442d service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:48.067692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-1f2004e7-3ba7-4e67-90c5-64cada9476e6 req-d2d02eb3-123b-4a1b-9a62-48c506ed442d service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:48.067926 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-1f2004e7-3ba7-4e67-90c5-64cada9476e6 req-d2d02eb3-123b-4a1b-9a62-48c506ed442d service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:48.096730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-1f2004e7-3ba7-4e67-90c5-64cada9476e6 req-d2d02eb3-123b-4a1b-9a62-48c506ed442d service nova] Creating event network-vif-deleted:75b4cfd2-89be-4ea3-90ab-3906f010564d for instance 7d8c38d1-af64-4696-bdab-e85587332b6e on hv-cinder-83608 Sep 26 05:54:48.102775 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-1f2004e7-3ba7-4e67-90c5-64cada9476e6 req-d2d02eb3-123b-4a1b-9a62-48c506ed442d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059884 Sep 26 05:54:48.103731 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 467/940] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:54:48.694677 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:48.696262 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:48.710141 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:48.712615 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:48.714307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:48.717553 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:48.718386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:48.721699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:48.835724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:48.836440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:48.849437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:48.850238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:48.850866 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:48.852036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:48.852697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:48.854487 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:48.872786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] HTTP exception thrown: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Request method failure captured: Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e HTTP/1.1 Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw2Uk72LS3P-k37oBL5TM0tyQo8Uj8xzZfHGDGAR-UjjBQuKYYErMJ9iwFB8F945IWFVXu-Svs0pq48SbhmEfk9Xj_RetiH0jOmsEAUt-_i3GnbSugO3bCWnq_Pn84YqQfgV24GYgK7Zrt_i1PBzlgtXxf19__OKHi0eBlXWJrDCQ8 Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:54:48.874732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9fc5a928f77549839c85f3ab7e7e13b6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 8c26eec9a5e841f8b760cc8cef309b18 Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:48.876194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '7d8c38d1-af64-4696-bdab-e85587332b6e'} Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:54:48.877074 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:48.880079 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:48.882668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Returning 404 to user: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:54:48.883530 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4d913818-8344-4dba-b21b-8b8405175232 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 404 len: 111 microversion: 2.1 time: 0.054336 Sep 26 05:54:48.886180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 468/941] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:48 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:54:48.897708 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a3fa8fc9-8e65-40d8-9a71-e9ec3a6fb469 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '.version_select at 0x7f1e5e572820>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:48.905574 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a3fa8fc9-8e65-40d8-9a71-e9ec3a6fb469 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [938c422f-80a5-4ef9-b6b7-1a5445399590] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 05:54:48.912573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:48.925557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:48.927467 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:48.928867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b47d6d93-8f6c-4516-a300-7cf877700ed4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1729 microversion: 2.20 time: 0.238260 Sep 26 05:54:48.929468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 474/942] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:48 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:49.917415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [None req-a3fa8fc9-8e65-40d8-9a71-e9ec3a6fb469 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [938c422f-80a5-4ef9-b6b7-1a5445399590] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 44224. Sep 26 05:54:49.947769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a3fa8fc9-8e65-40d8-9a71-e9ec3a6fb469 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303644116" status: 202 len: 0 microversion: 2.1 time: 1.056665 Sep 26 05:54:49.948499 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 469/943] 10.222.0.57 () {58 vars in 1221 bytes} [Mon Sep 26 05:54:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303644116 => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:54:49.955212 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:49.955807 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:49.962706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:49.963188 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:49.963618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:49.964311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:49.964762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:49.965187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:50.097806 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:50.107962 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:50.109761 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:54:50.111152 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8bf9feac-31e9-4375-8514-e81a8498669b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1716 microversion: 2.20 time: 0.159982 Sep 26 05:54:50.112372 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 475/944] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:54:49 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:54:52.896676 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:52.897306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:52.904604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:52.905103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:52.905721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:52.906522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:52.907212 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:52.907853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:52.926408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] HTTP exception thrown: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Request method failure captured: Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e HTTP/1.1 Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw2Uk72LS3P-k37oBL5TM0tyQo8Uj8xzZfHGDGAR-UjjBQuKYYErMJ9iwFB8F945IWFVXu-Svs0pq48SbhmEfk9Xj_RetiH0jOmsEAUt-_i3GnbSugO3bCWnq_Pn84YqQfgV24GYgK7Zrt_i1PBzlgtXxf19__OKHi0eBlXWJrDCQ8 Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:54:52.927994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9fc5a928f77549839c85f3ab7e7e13b6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 8c26eec9a5e841f8b760cc8cef309b18 Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.929554 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '7d8c38d1-af64-4696-bdab-e85587332b6e'} Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:54:52.930351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.931621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.932867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Returning 404 to user: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:54:52.932867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-23f2bee6-fd09-44d4-a6c1-a20a734147ff tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 404 len: 111 microversion: 2.1 time: 0.037419 Sep 26 05:54:52.932867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 470/945] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:54:52 2022] DELETE /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:54:52.938513 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:52.939133 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: 7d8c38d1-af64-4696-bdab-e85587332b6e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:52.947303 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:52.947798 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:52.948225 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:52.948927 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:52.949421 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:52.949839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:52.964706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] HTTP exception thrown: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Request method failure captured: Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e HTTP/1.1 Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw2Uk72LS3P-k37oBL5TM0tyQo8Uj8xzZfHGDGAR-UjjBQuKYYErMJ9iwFB8F945IWFVXu-Svs0pq48SbhmEfk9Xj_RetiH0jOmsEAUt-_i3GnbSugO3bCWnq_Pn84YqQfgV24GYgK7Zrt_i1PBzlgtXxf19__OKHi0eBlXWJrDCQ8 Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:54:52.966482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9fc5a928f77549839c85f3ab7e7e13b6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 8c26eec9a5e841f8b760cc8cef309b18 Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.968174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '7d8c38d1-af64-4696-bdab-e85587332b6e'} Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:54:52.969096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. Sep 26 05:54:52.970649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:52.971981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Returning 404 to user: Instance 7d8c38d1-af64-4696-bdab-e85587332b6e could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:54:52.971981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9fc632e1-fc3d-423f-b799-b655779662a2 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e" status: 404 len: 111 microversion: 2.1 time: 0.033272 Sep 26 05:54:52.971981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 476/946] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:52 2022] GET /compute/v2.1/servers/7d8c38d1-af64-4696-bdab-e85587332b6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:54:54.128532 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:54.129078 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:54.136388 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:54.136882 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:54.137356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:54.138065 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:54.138523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:54.138951 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:54.152845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] HTTP exception thrown: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Request method failure captured: Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b HTTP/1.1 Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw2Uk72LS3P-k37oBL5TM0tyQo8Uj8xzZfHGDGAR-UjjBQuKYYErMJ9iwFB8F945IWFVXu-Svs0pq48SbhmEfk9Xj_RetiH0jOmsEAUt-_i3GnbSugO3bCWnq_Pn84YqQfgV24GYgK7Zrt_i1PBzlgtXxf19__OKHi0eBlXWJrDCQ8 Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:54:54.154432 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9fc5a928f77549839c85f3ab7e7e13b6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 8c26eec9a5e841f8b760cc8cef309b18 Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.156009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'a0853094-da33-4e22-a597-b0df1980229b'} Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:54:54.156878 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.158383 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.159848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Returning 404 to user: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:54:54.159848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bb86a222-6fad-4c1a-9948-49a42d996e90 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 404 len: 111 microversion: 2.1 time: 0.031245 Sep 26 05:54:54.159848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 471/947] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:54:54 2022] DELETE /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:54:54.164524 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:54:54.165184 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] [instance: a0853094-da33-4e22-a597-b0df1980229b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:54:54.172388 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:54.172945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:54.173346 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:54.174039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:54:54.174503 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:54:54.174924 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:54:54.189323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] HTTP exception thrown: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Request method failure captured: Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b HTTP/1.1 Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw2Uk72LS3P-k37oBL5TM0tyQo8Uj8xzZfHGDGAR-UjjBQuKYYErMJ9iwFB8F945IWFVXu-Svs0pq48SbhmEfk9Xj_RetiH0jOmsEAUt-_i3GnbSugO3bCWnq_Pn84YqQfgV24GYgK7Zrt_i1PBzlgtXxf19__OKHi0eBlXWJrDCQ8 Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:54:54.190849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9fc5a928f77549839c85f3ab7e7e13b6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9fc5a928f77549839c85f3ab7e7e13b6", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 9fc5a928f77549839c85f3ab7e7e13b6 Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeTestJSON-682876007 Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 8c26eec9a5e841f8b760cc8cef309b18 Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeTestJSON-682876007-project Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.192492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': 'a0853094-da33-4e22-a597-b0df1980229b'} Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:54:54.193307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. Sep 26 05:54:54.194645 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:54:54.196000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] Returning 404 to user: Instance a0853094-da33-4e22-a597-b0df1980229b could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:54:54.196000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c56b105b-4f48-42e1-9d96-be7040b82e95 tempest-AttachVolumeTestJSON-682876007 tempest-AttachVolumeTestJSON-682876007-project] 10.222.0.57 "GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b" status: 404 len: 111 microversion: 2.1 time: 0.031573 Sep 26 05:54:54.196000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 477/948] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:54:54 2022] GET /compute/v2.1/servers/a0853094-da33-4e22-a597-b0df1980229b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:55:00.288841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f62fedf5-d4a0-44f7-92d0-5829c7b86dce tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e5e4a7b80>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:00.340935 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f62fedf5-d4a0-44f7-92d0-5829c7b86dce tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b7de3d31-6bd9-4a4b-9117-39aab8dc4ccf" status: 200 len: 349 microversion: 2.1 time: 0.055816 Sep 26 05:55:00.341539 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 472/949] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:55:00 2022] GET /compute/v2.1/os-volumes/b7de3d31-6bd9-4a4b-9117-39aab8dc4ccf => generated 349 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:01.718105 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8c7b3a43-8c70-4fae-8005-664ff4115659 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e61d41670>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:01.773976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8c7b3a43-8c70-4fae-8005-664ff4115659 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/84937651-e029-46ea-a6ce-d37fbcbb7ae2" status: 200 len: 350 microversion: 2.1 time: 0.060153 Sep 26 05:55:01.774738 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 478/950] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:55:01 2022] GET /compute/v2.1/os-volumes/84937651-e029-46ea-a6ce-d37fbcbb7ae2 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:03.155583 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-66114c00-52f2-481c-beef-9a9a5ea9cff2 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e5e57ad30>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.213493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-66114c00-52f2-481c-beef-9a9a5ea9cff2 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/a19fb45e-e4d6-4fbf-b160-a7e27f2d5946" status: 200 len: 350 microversion: 2.1 time: 0.063713 Sep 26 05:55:03.214256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 473/951] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes/a19fb45e-e4d6-4fbf-b160-a7e27f2d5946 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:03.232197 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d9268bc3-af4e-443e-8c6e-a616294ccf5c tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e5e3fbc10>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.325906 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d9268bc3-af4e-443e-8c6e-a616294ccf5c tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.100661 Sep 26 05:55:03.326504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 479/952] 10.222.0.57 () {58 vars in 1134 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:03.345064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-adf4830c-6692-4377-8336-abd5080a905e tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e5e36d700>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.429581 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-adf4830c-6692-4377-8336-abd5080a905e tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088655 Sep 26 05:55:03.430200 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 474/953] 10.222.0.57 () {58 vars in 1149 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:03.448496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-87fd7fe2-db95-4b05-bc17-8766bea1c1d8 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e61d8e670>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.545755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-87fd7fe2-db95-4b05-bc17-8766bea1c1d8 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.102886 Sep 26 05:55:03.546302 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 480/954] 10.222.0.57 () {58 vars in 1134 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:03.559769 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7666467a-672a-4f10-a83c-b940cd50a4f4 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e5e3ab160>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.656041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7666467a-672a-4f10-a83c-b940cd50a4f4 tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.099870 Sep 26 05:55:03.656835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 475/955] 10.222.0.57 () {58 vars in 1167 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:03.673875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2f4ea5e9-d224-4d96-bf99-b6f0625d24fa tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e61d419d0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.757185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2f4ea5e9-d224-4d96-bf99-b6f0625d24fa tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087238 Sep 26 05:55:03.757815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 481/956] 10.222.0.57 () {58 vars in 1170 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:03.773988 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3f1854c4-417f-4507-9aaa-ebedf16969fb tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e5e36de50>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.861795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3f1854c4-417f-4507-9aaa-ebedf16969fb tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.093442 Sep 26 05:55:03.862363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 476/957] 10.222.0.57 () {58 vars in 1155 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:03.876159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-75483790-c5d7-426e-859e-949fdefae8be tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e61d8c4c0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:03.964961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-75483790-c5d7-426e-859e-949fdefae8be tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092524 Sep 26 05:55:03.965556 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 482/958] 10.222.0.57 () {58 vars in 1188 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:03.979890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d7bff419-838c-4da2-ae69-5135e1ff425f tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] Calling method '.version_select at 0x7f1e5e682040>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:04.073737 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d7bff419-838c-4da2-ae69-5135e1ff425f tempest-VolumesTestJSON-1908832904 tempest-VolumesTestJSON-1908832904-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.097720 Sep 26 05:55:04.074363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 477/959] 10.222.0.57 () {58 vars in 1155 bytes} [Mon Sep 26 05:55:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:44.709650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:44.710875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:44.981875 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:44.982520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:44.991652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:44.992833 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:44.994107 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:44.995652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:44.996271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:44.996797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:45.025079 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-91435ae4-2aec-4dcf-9d4a-04996507dd94 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/ips" status: 200 len: 149 microversion: 2.1 time: 0.316936 Sep 26 05:55:45.025750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 483/960] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:55:44 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/ips => generated 149 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:46.443856 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:46.444625 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=74 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:46.451355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7992121-f626-4f08-93aa-09eb85f3f004"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:55:46.453789 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:46.462321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:46.462974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:46.463452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:46.464176 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:46.464798 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:46.465287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:46.822880 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-5aabf037-4516-458e-bcaf-82eac8fb3ffc tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "POST /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379527 Sep 26 05:55:46.823441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 478/961] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:55:46 2022] POST /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:55:54.550035 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:54.550642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:54.557977 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:54.558461 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:54.558888 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:54.559580 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:54.560029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:54.560441 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:54.662642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lazy-loading 'services' on Instance uuid 168ae322-faa2-4343-bee4-6312b82d0cbb {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:55:54.754410 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-66552880-908a-4285-8c01-611939fe2fe9 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments/d7992121-f626-4f08-93aa-09eb85f3f004" status: 202 len: 0 microversion: 2.1 time: 0.208227 Sep 26 05:55:54.755057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 484/962] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:55:54 2022] DELETE /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments/d7992121-f626-4f08-93aa-09eb85f3f004 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 05:55:54.765478 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:54.767882 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:54.774552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:54.775046 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:54.775445 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:54.776222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:54.776738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:54.777313 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:54.811527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c3da7324-7419-4335-b381-7f92b86600f5 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051406 Sep 26 05:55:54.812508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 479/963] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:55:54 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:55:55.825775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:55.828465 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:55.835945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:55.836438 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:55.836877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:55.837628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:55.838072 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:55.838507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:55.877306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3cc87bef-90f3-4b6a-94b9-331a860f9bfb tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056289 Sep 26 05:55:55.877896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 485/964] 10.222.0.57 () {58 vars in 1302 bytes} [Mon Sep 26 05:55:55 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 05:55:55.945829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:55.946370 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:55.953833 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:55.954326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:55.954766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:55.955822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:55.956280 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:55.956701 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:55.984664 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:55:56.068605 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e27f7c0a-7f4e-48e7-95c1-6d54da066444 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 204 len: 0 microversion: 2.1 time: 0.126788 Sep 26 05:55:56.069265 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 480/965] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:55:55 2022] DELETE /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:55:56.077667 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:56.078275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:56.085322 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:56.085819 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:56.086233 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:56.086927 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:56.087371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:56.087782 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:56.226535 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:56.236237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-825c24da-acbe-4a7f-9f27-718bf37452a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1682 microversion: 2.1 time: 0.162283 Sep 26 05:55:56.236754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 486/966] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:55:56 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:57.260396 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:57.261114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:57.268141 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.268621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.269039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:57.269784 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.270229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.270646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:57.423899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:57.432099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-131a81ac-bc85-45ea-acde-d40ed6a10b40 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1682 microversion: 2.1 time: 0.175903 Sep 26 05:55:57.432627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 481/967] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:55:57 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:57.654262 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:57.656435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:57.663370 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.663851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.664277 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:57.664979 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.665456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.665870 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:57.698074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fd474ddb-dd87-495a-ac16-d0b42b8da675 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047789 Sep 26 05:55:57.698655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 487/968] 10.222.0.57 () {60 vars in 1343 bytes} [Mon Sep 26 05:55:57 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:57.765036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:57.765545 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:57.771853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.772335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.772766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:57.773490 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.773954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.774367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:57.800508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:55:57.888641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e5f37c3b-62cd-47ac-8190-a834a6361882 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 204 len: 0 microversion: 2.20 time: 0.127161 Sep 26 05:55:57.889177 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 482/969] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Sep 26 05:55:57 2022] DELETE /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 05:55:57.898713 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:57.899481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:57.907368 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.907865 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.908306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:57.909025 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:57.909522 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:57.909941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:58.057643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:58.066605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:58.068052 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:58.069334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cc44b3ab-0290-4ba7-ae9d-e2675cdd0bb3 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.175431 Sep 26 05:55:58.069888 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 488/970] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:55:57 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:55:58.458428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:58.459197 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:58.466835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:58.467395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:58.467863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:58.468636 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:58.469174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:58.469648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:58.618254 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:58.626533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1d1d4a6b-cec6-461a-b594-e2156eab6794 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1682 microversion: 2.1 time: 0.173452 Sep 26 05:55:58.627111 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 483/971] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:55:58 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:55:59.101342 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:59.101918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:59.109113 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:59.109633 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:59.110078 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:59.110766 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:59.111208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:59.111640 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:59.251792 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:59.260848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:59.262324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:59.263970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-85c24c2c-3ed2-485c-aa5d-090effd22e47 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.168569 Sep 26 05:55:59.264825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 489/972] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:55:59 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:55:59.649877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:55:59.650502 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:55:59.657395 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:59.657883 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:59.658317 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:59.659013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:55:59.659456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:55:59.659881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:55:59.892963 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:55:59.901502 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2c8b32fa-4d3d-4e17-96bc-0055fbdfc6a2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1682 microversion: 2.1 time: 0.255647 Sep 26 05:55:59.902495 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 484/973] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:55:59 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:00.298083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:00.298682 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:00.309420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:00.309960 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:00.311337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:00.312115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:00.312600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:00.313013 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:00.451932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:00.461294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:00.462847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:00.463892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2680f813-e7f1-48d7-923d-9b091921a2ec tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1722 microversion: 2.20 time: 0.169878 Sep 26 05:56:00.464701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 490/974] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:56:00 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:56:00.663330 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-9542036f-08c0-40a0-a1d0-64869145c52a req-d1d8fd7e-58ec-49e5-a1fb-ba1c49e47886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168ae322-faa2-4343-bee4-6312b82d0cbb", "name": "network-vif-deleted", "tag": "bea9712c-9bb5-4df0-959b-0528f14cc976"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:56:00.684465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-9542036f-08c0-40a0-a1d0-64869145c52a req-d1d8fd7e-58ec-49e5-a1fb-ba1c49e47886 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:00.685048 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-9542036f-08c0-40a0-a1d0-64869145c52a req-d1d8fd7e-58ec-49e5-a1fb-ba1c49e47886 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:00.685720 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-9542036f-08c0-40a0-a1d0-64869145c52a req-d1d8fd7e-58ec-49e5-a1fb-ba1c49e47886 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:00.711665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-9542036f-08c0-40a0-a1d0-64869145c52a req-d1d8fd7e-58ec-49e5-a1fb-ba1c49e47886 service nova] Creating event network-vif-deleted:bea9712c-9bb5-4df0-959b-0528f14cc976 for instance 168ae322-faa2-4343-bee4-6312b82d0cbb on hv-cinder-83608 Sep 26 05:56:00.716740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-9542036f-08c0-40a0-a1d0-64869145c52a req-d1d8fd7e-58ec-49e5-a1fb-ba1c49e47886 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146555 Sep 26 05:56:00.717949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 485/975] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:00.924981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:00.925851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:00.932215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:00.932824 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:00.933385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:00.934334 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:00.934881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:00.935529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:00.968300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:00.968984 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:00.969553 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:00.970098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lazy-loading 'fault' on Instance uuid 168ae322-faa2-4343-bee4-6312b82d0cbb {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:56:01.019560 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfaf6a2b8a2348b4aa603cda5fe624f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa25d71f2194e638989c1e1d9ef30da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:01.028507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6d19a0aa-c0e4-4302-be93-cf5c4a55a1ae tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 200 len: 1332 microversion: 2.1 time: 0.107446 Sep 26 05:56:01.029090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 491/976] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:00 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:01.491203 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:01.492167 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:01.508221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:01.508781 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:01.509261 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:01.510081 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:01.510534 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:01.510963 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:01.629958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:01.640811 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:01.642293 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9d9e9c8e26774e739695b7e4d42eeafd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25d426f519e8498e80c6c85158bd9042', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:01.643514 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-02f16d29-f374-4a09-a3f0-443bbc738532 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 200 len: 1655 microversion: 2.20 time: 0.156882 Sep 26 05:56:01.644077 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 486/977] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:56:01 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 05:56:02.053370 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:02.053965 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:02.062602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:02.063365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:02.064052 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:02.064753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:02.065390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:02.065808 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:02.080793 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb HTTP/1.1 Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:02.082722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:02.084356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '168ae322-faa2-4343-bee4-6312b82d0cbb'} Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:02.085291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:02.086828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.088894 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:02.089928 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5b21a5ca-7f31-41e6-87d7-74856646a2f8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 404 len: 111 microversion: 2.1 time: 0.041682 Sep 26 05:56:02.090839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 492/978] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:02 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:02.099340 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8a874610-dda3-465c-a7e8-bc87a7182bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '.version_select at 0x7f1e5e57a9d0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:02.121171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8a874610-dda3-465c-a7e8-bc87a7182bda tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011680433" status: 202 len: 0 microversion: 2.1 time: 0.025513 Sep 26 05:56:02.121893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 487/979] 10.222.0.57 () {58 vars in 1221 bytes} [Mon Sep 26 05:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011680433 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:56:02.670904 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:02.671923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:02.678377 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:02.679007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:02.679596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:02.680398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:02.680949 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:02.681493 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:02.701862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] HTTP exception thrown: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Request method failure captured: Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 HTTP/1.1 Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5Oj7JQcjiU4GXqLuHLbTlC8ro5Xc8Jtn9tP-evEPEwQ9mA6YC2TEppR9cM_rIglE5AOuN6V8rQ6I9KWi1hKczCZfGat7uwIgTdPxQA8sSok9BKIBvEld32FUkjxfEc0a8XoVhIdUDHkOaBuM7qlkt3ALnT4cSZN_iSb3seSlm3-o Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:02.703529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25d426f519e8498e80c6c85158bd9042", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 9d9e9c8e26774e739695b7e4d42eeafd Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:02.705596 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '8953bd1b-2a0e-4f90-8177-08638164cf69'} Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:02.706536 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:02.707933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:02.710204 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Returning 404 to user: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:02.711298 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-dfc5d907-d95f-47cc-b53e-39acf52a6dbe tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 404 len: 111 microversion: 2.20 time: 0.044325 Sep 26 05:56:02.711936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 493/980] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:56:02 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:56:02.720803 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-048aecf3-faaa-4fbd-bcee-fac75d666ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '.version_select at 0x7f1e5e5ca0d0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:02.743563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-048aecf3-faaa-4fbd-bcee-fac75d666ec4 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-875129080" status: 204 len: 0 microversion: 2.20 time: 0.026925 Sep 26 05:56:02.744296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 488/981] 10.222.0.57 () {60 vars in 1259 bytes} [Mon Sep 26 05:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-875129080 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 26 05:56:02.767006 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-63915708-399e-40a2-aa3d-77da779d9e47 req-803a3ed1-76fe-498b-bef9-1c91edcb292b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8953bd1b-2a0e-4f90-8177-08638164cf69", "name": "network-vif-deleted", "tag": "eab744db-21fb-4b22-8514-b8bf28f598a7"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:56:02.796484 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-63915708-399e-40a2-aa3d-77da779d9e47 req-803a3ed1-76fe-498b-bef9-1c91edcb292b service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:02.797002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-63915708-399e-40a2-aa3d-77da779d9e47 req-803a3ed1-76fe-498b-bef9-1c91edcb292b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:02.797445 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-63915708-399e-40a2-aa3d-77da779d9e47 req-803a3ed1-76fe-498b-bef9-1c91edcb292b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:02.811179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-63915708-399e-40a2-aa3d-77da779d9e47 req-803a3ed1-76fe-498b-bef9-1c91edcb292b service nova] Creating event network-vif-deleted:eab744db-21fb-4b22-8514-b8bf28f598a7 for instance 8953bd1b-2a0e-4f90-8177-08638164cf69 on hv-cinder-83608 Sep 26 05:56:02.817567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-63915708-399e-40a2-aa3d-77da779d9e47 req-803a3ed1-76fe-498b-bef9-1c91edcb292b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057659 Sep 26 05:56:02.818638 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 494/982] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:03.955414 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:03.955988 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:03.963436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:03.963925 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:03.964368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:03.965067 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:03.965568 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:03.965990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:03.979821 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb HTTP/1.1 Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:03.981591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:03.983231 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '168ae322-faa2-4343-bee4-6312b82d0cbb'} Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:03.984119 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:03.985640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:03.987080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:03.987080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6c54bf5a-d85a-4121-93ce-0188fe5ae29c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 404 len: 111 microversion: 2.1 time: 0.034760 Sep 26 05:56:03.987080 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 489/983] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:56:03 2022] DELETE /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:03.993027 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:03.993755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 168ae322-faa2-4343-bee4-6312b82d0cbb] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:04.000299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:04.000788 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:04.001269 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:04.001961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:04.002391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:04.002838 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:04.022203 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb HTTP/1.1 Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:04.023829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:04.025373 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '168ae322-faa2-4343-bee4-6312b82d0cbb'} Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:04.026332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. Sep 26 05:56:04.027834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.029318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 168ae322-faa2-4343-bee4-6312b82d0cbb could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:04.029318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-46ca68bb-7464-4b42-9eba-d4518631569f tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb" status: 404 len: 111 microversion: 2.1 time: 0.037117 Sep 26 05:56:04.029318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 495/984] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:03 2022] GET /compute/v2.1/servers/168ae322-faa2-4343-bee4-6312b82d0cbb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:04.591516 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:04.592136 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:04.599834 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:04.600349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:04.600861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:04.601808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:04.602276 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:04.602695 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:04.616993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] HTTP exception thrown: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Request method failure captured: Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 HTTP/1.1 Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5Oj7JQcjiU4GXqLuHLbTlC8ro5Xc8Jtn9tP-evEPEwQ9mA6YC2TEppR9cM_rIglE5AOuN6V8rQ6I9KWi1hKczCZfGat7uwIgTdPxQA8sSok9BKIBvEld32FUkjxfEc0a8XoVhIdUDHkOaBuM7qlkt3ALnT4cSZN_iSb3seSlm3-o Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:04.618615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25d426f519e8498e80c6c85158bd9042", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 9d9e9c8e26774e739695b7e4d42eeafd Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.620222 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '8953bd1b-2a0e-4f90-8177-08638164cf69'} Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:04.621321 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.622823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.624334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Returning 404 to user: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:04.624334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-e6b328f6-c8ed-49fb-883d-fcd484dd616c tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 404 len: 111 microversion: 2.20 time: 0.032514 Sep 26 05:56:04.624334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 490/985] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Sep 26 05:56:04 2022] DELETE /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:56:04.628737 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:04.629398 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: 8953bd1b-2a0e-4f90-8177-08638164cf69] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:04.635844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:04.636321 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:04.636754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:04.637466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:04.637921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:04.638333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:04.807213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] HTTP exception thrown: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Request method failure captured: Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 HTTP/1.1 Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5Oj7JQcjiU4GXqLuHLbTlC8ro5Xc8Jtn9tP-evEPEwQ9mA6YC2TEppR9cM_rIglE5AOuN6V8rQ6I9KWi1hKczCZfGat7uwIgTdPxQA8sSok9BKIBvEld32FUkjxfEc0a8XoVhIdUDHkOaBuM7qlkt3ALnT4cSZN_iSb3seSlm3-o Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:04.808748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25d426f519e8498e80c6c85158bd9042", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 9d9e9c8e26774e739695b7e4d42eeafd Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.810508 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '8953bd1b-2a0e-4f90-8177-08638164cf69'} Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:04.811420 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. Sep 26 05:56:04.812941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:04.814347 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Returning 404 to user: Instance 8953bd1b-2a0e-4f90-8177-08638164cf69 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:04.814347 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-55f140a3-4531-4a14-b2b0-78efc8696a02 tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69" status: 404 len: 111 microversion: 2.20 time: 0.185411 Sep 26 05:56:04.814347 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 496/986] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:56:04 2022] GET /compute/v2.1/servers/8953bd1b-2a0e-4f90-8177-08638164cf69 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:56:05.188291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:05.188965 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:05.195730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.196217 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.196650 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.197451 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.197906 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.198328 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.212697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e HTTP/1.1 Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:05.214332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.216005 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '430ecb3c-5a38-48a6-8054-84029ce9705e'} Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:05.216824 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.218095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.220281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:05.220281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a24931d7-9675-4ce0-acbd-25344b8ebce8 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 404 len: 111 microversion: 2.1 time: 0.031404 Sep 26 05:56:05.220281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 491/987] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:56:05 2022] DELETE /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:05.224493 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:05.225104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 430ecb3c-5a38-48a6-8054-84029ce9705e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:05.232112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.232687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.233157 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.233988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.234477 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.234968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.250166 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e HTTP/1.1 Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:05.251769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.253463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '430ecb3c-5a38-48a6-8054-84029ce9705e'} Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:05.254365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. Sep 26 05:56:05.256221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.257707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 430ecb3c-5a38-48a6-8054-84029ce9705e could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:05.257707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a0fc6819-c89d-425b-b0aa-a747d97ea457 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e" status: 404 len: 111 microversion: 2.1 time: 0.032614 Sep 26 05:56:05.257707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 497/988] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:05 2022] GET /compute/v2.1/servers/430ecb3c-5a38-48a6-8054-84029ce9705e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:05.262731 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:05.263215 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:05.270391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.270938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.271388 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.272201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.272761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.273218 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.288150 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 HTTP/1.1 Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:05.289908 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.291614 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '00537282-21fe-4a1e-ac28-4375d53cb8e6'} Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:05.292641 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.294183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.295707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:05.295707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b7909d34-57f4-4afc-a8d9-9ba07e4c94b2 tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 404 len: 111 microversion: 2.1 time: 0.032581 Sep 26 05:56:05.295707 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 492/989] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:56:05 2022] DELETE /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:56:05.305071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:05.305756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: 00537282-21fe-4a1e-ac28-4375d53cb8e6] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:05.311825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.312296 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.312722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.313432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.313877 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.314290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.329991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 HTTP/1.1 Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:05.331821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.333492 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '00537282-21fe-4a1e-ac28-4375d53cb8e6'} Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:05.334386 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. Sep 26 05:56:05.336042 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.337466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance 00537282-21fe-4a1e-ac28-4375d53cb8e6 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:05.337466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7c38c569-3b35-417e-91a1-5ea39191651c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6" status: 404 len: 111 microversion: 2.1 time: 0.032632 Sep 26 05:56:05.337466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 498/990] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:05 2022] GET /compute/v2.1/servers/00537282-21fe-4a1e-ac28-4375d53cb8e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:56:05.966892 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:05.967385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:05.973844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.974319 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.974752 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.975448 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:05.975909 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:05.976392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:05.990298 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] HTTP exception thrown: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Request method failure captured: Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b HTTP/1.1 Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5Oj7JQcjiU4GXqLuHLbTlC8ro5Xc8Jtn9tP-evEPEwQ9mA6YC2TEppR9cM_rIglE5AOuN6V8rQ6I9KWi1hKczCZfGat7uwIgTdPxQA8sSok9BKIBvEld32FUkjxfEc0a8XoVhIdUDHkOaBuM7qlkt3ALnT4cSZN_iSb3seSlm3-o Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:05.991928 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25d426f519e8498e80c6c85158bd9042", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 9d9e9c8e26774e739695b7e4d42eeafd Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:05.993508 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'c1734960-6d94-4c7b-b6e4-0556d841388b'} Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:05.994279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:05.995877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:05.997422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Returning 404 to user: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:05.997422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7a5b9765-3b7a-4918-9948-26a71c497cca tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 404 len: 111 microversion: 2.20 time: 0.030410 Sep 26 05:56:05.997422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 493/991] 10.222.0.57 () {60 vars in 1280 bytes} [Mon Sep 26 05:56:05 2022] DELETE /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:56:06.002039 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:06.002654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] [instance: c1734960-6d94-4c7b-b6e4-0556d841388b] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:06.009093 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:06.009543 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:06.009978 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:06.010663 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:06.011127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:06.011546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:06.025005 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] HTTP exception thrown: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Request method failure captured: Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b HTTP/1.1 Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5Oj7JQcjiU4GXqLuHLbTlC8ro5Xc8Jtn9tP-evEPEwQ9mA6YC2TEppR9cM_rIglE5AOuN6V8rQ6I9KWi1hKczCZfGat7uwIgTdPxQA8sSok9BKIBvEld32FUkjxfEc0a8XoVhIdUDHkOaBuM7qlkt3ALnT4cSZN_iSb3seSlm3-o Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:06.026579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/25d426f519e8498e80c6c85158bd9042"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_25d426f519e8498e80c6c85158bd9042", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 25d426f519e8498e80c6c85158bd9042 Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1472510199 Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 9d9e9c8e26774e739695b7e4d42eeafd Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1472510199-project Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:06.028237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': 'c1734960-6d94-4c7b-b6e4-0556d841388b'} Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:06.029244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. Sep 26 05:56:06.030703 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.032020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] Returning 404 to user: Instance c1734960-6d94-4c7b-b6e4-0556d841388b could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:06.032020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fd82d560-9ef2-4ccd-9b1c-e396f9ebfa7b tempest-AttachVolumeShelveTestJSON-1472510199 tempest-AttachVolumeShelveTestJSON-1472510199-project] 10.222.0.57 "GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b" status: 404 len: 111 microversion: 2.20 time: 0.029796 Sep 26 05:56:06.032020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 499/992] 10.222.0.57 () {60 vars in 1277 bytes} [Mon Sep 26 05:56:05 2022] GET /compute/v2.1/servers/c1734960-6d94-4c7b-b6e4-0556d841388b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 05:56:06.481253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:06.482143 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:06.489159 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:06.489639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:06.490110 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:06.490843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:06.491287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:06.491730 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:06.506224 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a HTTP/1.1 Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:06.507912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.509343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'ea993d78-323c-4565-9a8e-db170bd7954a'} Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:06.510128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.511359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.512592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:06.512592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7bba84ca-6799-4f8d-b385-2fca92dd709c tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 404 len: 111 microversion: 2.1 time: 0.033221 Sep 26 05:56:06.512592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 494/993] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:56:06 2022] DELETE /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:06.518180 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:06.518791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] [instance: ea993d78-323c-4565-9a8e-db170bd7954a] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:06.525285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:06.525769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:06.526201 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:06.526891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:06.527341 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:06.527766 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:06.543735 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] HTTP exception thrown: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Request method failure captured: Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a HTTP/1.1 Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMTw5TxMIZok-uk16xgwZt9ywywc5xxf1XwD-lv6u6Fr2-j9MaYetGKDxUwREEVlJQ_Yn_w7kGJoNRUahx_mbP2M8NZOsbPDrJjMm0psCIARS_jaGxGAFQbqQ1-QUFy7iiPUwoMW5YhRVJ89M3zX9hMvoms6rlmHuCPk95LpYrrAuSLE Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:06.545337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3fa25d71f2194e638989c1e1d9ef30da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3fa25d71f2194e638989c1e1d9ef30da", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 3fa25d71f2194e638989c1e1d9ef30da Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-166602866 Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: bfaf6a2b8a2348b4aa603cda5fe624f5 Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-AttachVolumeNegativeTest-166602866-project Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.546757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': 'ea993d78-323c-4565-9a8e-db170bd7954a'} Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:06.547531 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. Sep 26 05:56:06.548970 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:06.550358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] Returning 404 to user: Instance ea993d78-323c-4565-9a8e-db170bd7954a could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:06.550358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ab7eae64-a2d5-4f28-9d9f-7ea2ade69fef tempest-AttachVolumeNegativeTest-166602866 tempest-AttachVolumeNegativeTest-166602866-project] 10.222.0.57 "GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a" status: 404 len: 111 microversion: 2.1 time: 0.032404 Sep 26 05:56:06.550358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 500/994] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:06 2022] GET /compute/v2.1/servers/ea993d78-323c-4565-9a8e-db170bd7954a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 05:56:12.040510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fb04e696-a7ab-4c61-8f0d-7a24b6acf9d8 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Action: 'create', calling method: .version_select at 0x7f1e5e3fe9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-813274336"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:56:12.357239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fb04e696-a7ab-4c61-8f0d-7a24b6acf9d8 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.434802 Sep 26 05:56:12.357865 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 495/995] 10.222.0.57 () {60 vars in 1155 bytes} [Mon Sep 26 05:56:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 05:56:12.370905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-baec35dd-55d9-4d80-b90f-e4f36b963588 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e61d8e940>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:12.431026 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-baec35dd-55d9-4d80-b90f-e4f36b963588 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 200 len: 344 microversion: 2.1 time: 0.063852 Sep 26 05:56:12.431656 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 501/996] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:12 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:13.448312 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-98d04e97-73ad-4773-bd96-cee4e8b16186 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e578b80>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:13.497604 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-98d04e97-73ad-4773-bd96-cee4e8b16186 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 200 len: 344 microversion: 2.1 time: 0.054683 Sep 26 05:56:13.498187 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 496/997] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:13 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:14.515683 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-b11bff82-66c5-469c-8d59-8f4140bcf0e5 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e3b2790>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:14.568034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-b11bff82-66c5-469c-8d59-8f4140bcf0e5 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 200 len: 344 microversion: 2.1 time: 0.058521 Sep 26 05:56:14.568605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 502/998] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:14 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:15.584832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-94f0398b-0488-4f5d-a32c-fb98414eb7f5 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e2f6af0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:15.636507 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-94f0398b-0488-4f5d-a32c-fb98414eb7f5 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 200 len: 344 microversion: 2.1 time: 0.056345 Sep 26 05:56:15.637246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 497/999] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:15 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:16.649250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=38 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:16.650382 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:16.656713 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f31e8844-49c6-4800-b65a-083091db3b73 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e61daa550>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:16.708698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f31e8844-49c6-4800-b65a-083091db3b73 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 200 len: 345 microversion: 2.1 time: 0.060862 Sep 26 05:56:16.709352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 503/1000] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:16 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:16.720195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:16.721602 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:16.726309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7f567b7c-f663-43c6-a29b-c7bbd203790c tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Action: 'create', calling method: .version_select at 0x7f1e5e5caf70>, body: {"snapshot": {"volume_id": "eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1994177869"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:56:16.906384 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7f567b7c-f663-43c6-a29b-c7bbd203790c tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.186876 Sep 26 05:56:16.913544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 498/1001] 10.222.0.57 () {60 vars in 1162 bytes} [Mon Sep 26 05:56:16 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:16.918914 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6eefab09-7e49-477f-9f02-a764f9ecb935 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e61d8e670>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:16.949328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6eefab09-7e49-477f-9f02-a764f9ecb935 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 287 microversion: 2.1 time: 0.034565 Sep 26 05:56:16.949918 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 504/1002] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:16 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:56:16.961389 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-47eae801-a879-402d-b5e1-cbddfe8ae73d tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e317c10>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:16.993195 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-47eae801-a879-402d-b5e1-cbddfe8ae73d tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035580 Sep 26 05:56:16.993764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 499/1003] 10.222.0.57 () {58 vars in 1140 bytes} [Mon Sep 26 05:56:16 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:17.005125 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-211e06c3-1d1c-44cd-b1cd-1ecb62ee9e13 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e89dc10>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:17.035542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-211e06c3-1d1c-44cd-b1cd-1ecb62ee9e13 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 287 microversion: 2.1 time: 0.034215 Sep 26 05:56:17.036222 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 505/1004] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:17 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:18.048611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-639e7c5f-803f-43e3-b57c-276456a9112c tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e317820>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:18.084561 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-639e7c5f-803f-43e3-b57c-276456a9112c tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 287 microversion: 2.1 time: 0.040411 Sep 26 05:56:18.085206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 500/1005] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:18 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:19.097540 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-24a40474-899a-4b3f-9ee2-8a84b71fd04f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e3b25e0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:19.128215 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-24a40474-899a-4b3f-9ee2-8a84b71fd04f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 287 microversion: 2.1 time: 0.034998 Sep 26 05:56:19.128771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 506/1006] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:19 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:20.142036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-70671677-401e-443f-825b-c1b84aa602e8 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e5caca0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:20.172449 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-70671677-401e-443f-825b-c1b84aa602e8 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 287 microversion: 2.1 time: 0.034793 Sep 26 05:56:20.173014 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 501/1007] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:20 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:21.186362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-2d0d623d-82ed-4f93-b0b2-2b1da027e540 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e61d8e550>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:21.216913 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-2d0d623d-82ed-4f93-b0b2-2b1da027e540 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 287 microversion: 2.1 time: 0.035001 Sep 26 05:56:21.217676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 507/1008] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:21 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:22.232413 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-87061dcc-e79a-4c2f-8b46-e159be57d97c tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e5bf550>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:22.268292 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-87061dcc-e79a-4c2f-8b46-e159be57d97c tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 288 microversion: 2.1 time: 0.040402 Sep 26 05:56:22.268835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 502/1009] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:22 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:22.283156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d756166b-7d1c-4815-b31d-bef999f20cbe tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e3b28b0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:22.349878 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d756166b-7d1c-4815-b31d-bef999f20cbe tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 202 len: 0 microversion: 2.1 time: 0.073167 Sep 26 05:56:22.350457 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 508/1010] 10.222.0.57 () {58 vars in 1254 bytes} [Mon Sep 26 05:56:22 2022] DELETE /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:56:22.359236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-58a50710-4c30-4a40-8856-40f1498a4437 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e3fe9d0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:22.390915 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-58a50710-4c30-4a40-8856-40f1498a4437 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 200 len: 287 microversion: 2.1 time: 0.035770 Sep 26 05:56:22.391500 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 503/1011] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:22 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:23.406156 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3cfeba28-b055-45ad-a5ff-7c7ee70d7f68 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e410820>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:23.432903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-3cfeba28-b055-45ad-a5ff-7c7ee70d7f68 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] HTTP exception thrown: Snapshot a9319981-4bfd-4d99-98f1-6d091f4b4890 could not be found. Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3cfeba28-b055-45ad-a5ff-7c7ee70d7f68 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Request method failure captured: Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 HTTP/1.1 Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMT776OBJKCxlwtd0tzbPkx6XptRMoSCaBJxLRwBLA2yDItLFT-W5ihLukkBGuZ9TujdnHlfPk4xjWE9fLMksP75K8Vx0JUBlqLF6BZqGV76SptDtyCWGoQSvvMj3Jx3hex1h1BuXPkLcaJZJ9D2uMcHvNyNhQ2bnE1-EylQ5g7ULTKQ Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:23.436217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_af67c46729744f6fa0a469ddcf55f47b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 34f8e59ebe064983a4bb3411d715e66c Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Snapshot a9319981-4bfd-4d99-98f1-6d091f4b4890 could not be found. Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': 'a9319981-4bfd-4d99-98f1-6d091f4b4890'} Sep 26 05:56:23.437972 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a9319981-4bfd-4d99-98f1-6d091f4b4890 could not be found. (HTTP 404) (Request-ID: req-1e6724a3-ecff-417a-b5d5-e9011c49737b) Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:23.438994 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:56:23.440352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a9319981-4bfd-4d99-98f1-6d091f4b4890 could not be found. Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 26 05:56:23.441753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a9319981-4bfd-4d99-98f1-6d091f4b4890 could not be found. Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a9319981-4bfd-4d99-98f1-6d091f4b4890 could not be found. Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3cfeba28-b055-45ad-a5ff-7c7ee70d7f68 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Returning 404 to user: Snapshot a9319981-4bfd-4d99-98f1-6d091f4b4890 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:23.443255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3cfeba28-b055-45ad-a5ff-7c7ee70d7f68 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890" status: 404 len: 111 microversion: 2.1 time: 0.036483 Sep 26 05:56:23.444261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 509/1012] 10.222.0.57 () {58 vars in 1251 bytes} [Mon Sep 26 05:56:23 2022] GET /compute/v2.1/os-snapshots/a9319981-4bfd-4d99-98f1-6d091f4b4890 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:23.447055 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-52819c6f-ccd8-4cb2-a1a6-ee5d9bd4d180 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e592d30>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:23.521341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-52819c6f-ccd8-4cb2-a1a6-ee5d9bd4d180 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 202 len: 0 microversion: 2.1 time: 0.078193 Sep 26 05:56:23.522273 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 504/1013] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:56:23 2022] DELETE /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:56:23.532675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0d7cd133-20c4-443a-8678-91daea79206f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e9508b0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:23.580642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0d7cd133-20c4-443a-8678-91daea79206f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 200 len: 344 microversion: 2.1 time: 0.051764 Sep 26 05:56:23.581227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 510/1014] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:23 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:24.597018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a3c6e7a4-825c-4ee2-97df-f252f29d558f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e2bb9d0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:24.626509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-a3c6e7a4-825c-4ee2-97df-f252f29d558f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] HTTP exception thrown: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a3c6e7a4-825c-4ee2-97df-f252f29d558f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Request method failure captured: Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 HTTP/1.1 Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT776OBJKCxlwtd0tzbPkx6XptRMoSCaBJxLRwBLA2yDItLFT-W5ihLukkBGuZ9TujdnHlfPk4xjWE9fLMksP75K8Vx0JUBlqLF6BZqGV76SptDtyCWGoQSvvMj3Jx3hex1h1BuXPkLcaJZJ9D2uMcHvNyNhQ2bnE1-EylQ5g7ULTKQ Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:24.629047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_af67c46729744f6fa0a469ddcf55f47b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 34f8e59ebe064983a4bb3411d715e66c Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8'} Sep 26 05:56:24.630712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. (HTTP 404) (Request-ID: req-ee4f249a-062a-4251-96cb-88f14cb7ad76) Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.631668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:56:24.633045 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:56:24.634645 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a3c6e7a4-825c-4ee2-97df-f252f29d558f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Returning 404 to user: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a3c6e7a4-825c-4ee2-97df-f252f29d558f tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 404 len: 109 microversion: 2.1 time: 0.039232 Sep 26 05:56:24.635964 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 505/1015] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:24 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:24.648187 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6ae28d81-4677-42cd-a389-71ae47d5a554 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e47fee0>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:24.678384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-6ae28d81-4677-42cd-a389-71ae47d5a554 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] HTTP exception thrown: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6ae28d81-4677-42cd-a389-71ae47d5a554 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Request method failure captured: Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: DELETE /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 HTTP/1.1 Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMT776OBJKCxlwtd0tzbPkx6XptRMoSCaBJxLRwBLA2yDItLFT-W5ihLukkBGuZ9TujdnHlfPk4xjWE9fLMksP75K8Vx0JUBlqLF6BZqGV76SptDtyCWGoQSvvMj3Jx3hex1h1BuXPkLcaJZJ9D2uMcHvNyNhQ2bnE1-EylQ5g7ULTKQ Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 05:56:24.681921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_af67c46729744f6fa0a469ddcf55f47b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 34f8e59ebe064983a4bb3411d715e66c Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': 'eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8'} Sep 26 05:56:24.683618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. (HTTP 404) (Request-ID: req-26839ef5-a4ac-4a1c-852e-848588585ed9) Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.684670 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 05:56:24.686104 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 05:56:24.687507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6ae28d81-4677-42cd-a389-71ae47d5a554 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Returning 404 to user: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6ae28d81-4677-42cd-a389-71ae47d5a554 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 404 len: 109 microversion: 2.1 time: 0.040019 Sep 26 05:56:24.689219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 511/1016] 10.222.0.57 () {58 vars in 1248 bytes} [Mon Sep 26 05:56:24 2022] DELETE /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:24.693910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d8021c71-54db-402b-ad33-5005c92da9f3 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Calling method '.version_select at 0x7f1e5e2bb3a0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:24.728504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-d8021c71-54db-402b-ad33-5005c92da9f3 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] HTTP exception thrown: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d8021c71-54db-402b-ad33-5005c92da9f3 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Request method failure captured: Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 HTTP/1.1 Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT776OBJKCxlwtd0tzbPkx6XptRMoSCaBJxLRwBLA2yDItLFT-W5ihLukkBGuZ9TujdnHlfPk4xjWE9fLMksP75K8Vx0JUBlqLF6BZqGV76SptDtyCWGoQSvvMj3Jx3hex1h1BuXPkLcaJZJ9D2uMcHvNyNhQ2bnE1-EylQ5g7ULTKQ Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:56:24.731688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/af67c46729744f6fa0a469ddcf55f47b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_af67c46729744f6fa0a469ddcf55f47b", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: af67c46729744f6fa0a469ddcf55f47b Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-843090753 Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 34f8e59ebe064983a4bb3411d715e66c Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-843090753-project Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8'} Sep 26 05:56:24.733326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. (HTTP 404) (Request-ID: req-686adb73-bd05-4f9c-9c13-2c3c5dab9896) Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.734320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 05:56:24.735721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 05:56:24.737102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d8021c71-54db-402b-ad33-5005c92da9f3 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] Returning 404 to user: Volume eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d8021c71-54db-402b-ad33-5005c92da9f3 tempest-VolumesSnapshotsTestJSON-843090753 tempest-VolumesSnapshotsTestJSON-843090753-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8" status: 404 len: 109 microversion: 2.1 time: 0.044353 Sep 26 05:56:24.738524 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 506/1017] 10.222.0.57 () {58 vars in 1245 bytes} [Mon Sep 26 05:56:24 2022] GET /compute/v2.1/os-volumes/eb9030b2-a4a3-4a5c-b7bf-e13d69e3cac8 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:56:29.145773 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-161002785", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "networks": [{"uuid": "033e951b-5e4f-4458-a303-5df31393f5da"}]}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:56:29.200139 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] validate_networks() for [('033e951b-5e4f-4458-a303-5df31393f5da', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:56:29.739935 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:56:29.740348 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:56:29.740811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:56:29.741235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:56:29.741639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:56:29.755044 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:29.755629 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:29.756198 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:29.756976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:29.757546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:29.758017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:29.778345 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Getting quotas for project fa25b13404c54cff94e3c12198e9c313. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:56:29.783055 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Getting quotas for user 00928159647d47d6b324c0c11231465e and project fa25b13404c54cff94e3c12198e9c313. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:56:29.796309 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:56:29.799406 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:56:29.849547 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [520e8e4e-9ee8-495d-b045-952a88d59cf6] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 05:56:30.857468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [520e8e4e-9ee8-495d-b045-952a88d59cf6] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 45706. Sep 26 05:56:30.862391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a87e7086-7e15-486f-86e7-eabdeb4c0d1b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721200 Sep 26 05:56:30.863024 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 512/1018] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:56:30.876665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6e0ccc5e-1846-4885-b81c-4d0ccbf6b39f tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:30.877291 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6e0ccc5e-1846-4885-b81c-4d0ccbf6b39f tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:30.931359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6e0ccc5e-1846-4885-b81c-4d0ccbf6b39f tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:30.940009 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6e0ccc5e-1846-4885-b81c-4d0ccbf6b39f tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1218 microversion: 2.1 time: 0.069319 Sep 26 05:56:30.940599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 507/1019] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:30 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:31.964654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:31.965291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:31.972065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:31.972628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:31.973056 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:31.973943 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:31.974391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:31.974801 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:32.043341 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:32.053525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ec569441-bb5d-42b7-bbdd-4756bb363283 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1270 microversion: 2.1 time: 0.093125 Sep 26 05:56:32.054285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 513/1020] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:31 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:56:33.076683 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:33.077390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:33.089015 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:33.089767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:33.090233 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:33.093986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:33.095633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:33.096451 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:33.306161 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:33.314415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0df3278c-a877-40b2-97bc-ff6f5a9a76d8 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.241423 Sep 26 05:56:33.314945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 508/1021] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:33 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:33.718897 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-cc10d4fe-f803-46b3-b352-af8865edd507 req-fb52fd27-a2fa-4176-9387-b3b55fcb27c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e90c4336-6231-427f-8fc1-ef229a795a4e", "tag": "43477020-5aa0-47f6-86e5-ff2f91441d05"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:56:33.734590 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-cc10d4fe-f803-46b3-b352-af8865edd507 req-fb52fd27-a2fa-4176-9387-b3b55fcb27c9 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:33.736365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-cc10d4fe-f803-46b3-b352-af8865edd507 req-fb52fd27-a2fa-4176-9387-b3b55fcb27c9 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:33.736965 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-cc10d4fe-f803-46b3-b352-af8865edd507 req-fb52fd27-a2fa-4176-9387-b3b55fcb27c9 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:33.752229 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-cc10d4fe-f803-46b3-b352-af8865edd507 req-fb52fd27-a2fa-4176-9387-b3b55fcb27c9 service nova] Creating event network-changed:43477020-5aa0-47f6-86e5-ff2f91441d05 for instance e90c4336-6231-427f-8fc1-ef229a795a4e on hv-cinder-83608 Sep 26 05:56:33.758520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-cc10d4fe-f803-46b3-b352-af8865edd507 req-fb52fd27-a2fa-4176-9387-b3b55fcb27c9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047251 Sep 26 05:56:33.759557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 514/1022] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:34.338956 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:34.339939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:34.347282 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:34.347961 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:34.348447 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:34.349114 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:34.349944 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:34.350537 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:34.501025 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:34.511776 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-be411ddb-a027-4840-9dd4-a32f157ec174 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.177143 Sep 26 05:56:34.512628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 509/1023] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:34 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:35.539896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:35.540473 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:35.550339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:35.550961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:35.551768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:35.552546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:35.553081 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:35.553489 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:35.698367 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:35.708921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4e001e0b-84fb-4fed-bafd-176e67be6a87 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.176555 Sep 26 05:56:35.710081 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 515/1024] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:35 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:36.732328 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:36.733577 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:36.740807 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:36.741652 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:36.742443 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:36.743859 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:36.744430 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:36.744962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:36.963596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:36.972580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-dd58a976-1680-49f5-bc1f-d9ffd08e1566 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.244523 Sep 26 05:56:36.973285 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 510/1025] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:36 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:37.995931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:37.996675 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:38.004045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:38.004598 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:38.005089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:38.005899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:38.006567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:38.007149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:38.149507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:38.159851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c042fc9e-6536-4bcc-8e10-7cf156789a7d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.167795 Sep 26 05:56:38.174678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 516/1026] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:37 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:39.185833 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:39.186918 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:39.197393 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:39.198209 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:39.198912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:39.200055 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:39.200715 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:39.201482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:39.338611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:39.346791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d3990335-fb96-44fa-86a8-acea5d887854 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.167687 Sep 26 05:56:39.347375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 511/1027] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:39 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:56:40.109485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-59cee7d7-fe12-454d-bf3a-d054bce2e208 req-9d224a1a-89c0-436a-a448-b31a00a29b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90c4336-6231-427f-8fc1-ef229a795a4e", "name": "network-vif-plugged", "status": "completed", "tag": "43477020-5aa0-47f6-86e5-ff2f91441d05"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:56:40.117061 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:40.117742 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=6 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:40.124931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-59cee7d7-fe12-454d-bf3a-d054bce2e208 req-9d224a1a-89c0-436a-a448-b31a00a29b49 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:40.125498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-59cee7d7-fe12-454d-bf3a-d054bce2e208 req-9d224a1a-89c0-436a-a448-b31a00a29b49 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:40.125964 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-59cee7d7-fe12-454d-bf3a-d054bce2e208 req-9d224a1a-89c0-436a-a448-b31a00a29b49 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:40.139710 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-59cee7d7-fe12-454d-bf3a-d054bce2e208 req-9d224a1a-89c0-436a-a448-b31a00a29b49 service nova] Creating event network-vif-plugged:43477020-5aa0-47f6-86e5-ff2f91441d05 for instance e90c4336-6231-427f-8fc1-ef229a795a4e on hv-cinder-83608 Sep 26 05:56:40.144638 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-59cee7d7-fe12-454d-bf3a-d054bce2e208 req-9d224a1a-89c0-436a-a448-b31a00a29b49 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038895 Sep 26 05:56:40.145425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 517/1028] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:56:40.369504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:40.370202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:40.377084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:40.377678 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:40.378170 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:40.378943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:40.379464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:40.379953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:40.549688 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:40.558166 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-428a79e1-e54f-405f-ac1a-84aebd8aed39 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.192613 Sep 26 05:56:40.558954 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 512/1029] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:40 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:56:41.584497 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:41.585247 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:41.592854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:41.595801 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:41.596237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:41.596976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:41.597432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:41.597860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:41.750658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:41.761757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f2275312-f3aa-456d-a61d-758f16e9e6e5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1318 microversion: 2.1 time: 0.179755 Sep 26 05:56:41.761757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 518/1030] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:41 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 05:56:42.784706 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:56:42.785405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:56:42.787374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:42.794106 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:42.794685 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:42.795168 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:42.796226 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:56:42.796632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:56:42.796985 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:56:42.960561 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:56:42.968747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-633b7dcf-90b1-41d7-9eb5-7373e6a978d4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1508 microversion: 2.1 time: 0.189683 Sep 26 05:56:42.969599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 513/1031] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:56:42 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:57:18.547929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40ad2629-a15b-4365-b52f-06163e3f6129", "device": "/dev/sdb"}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:57:18.550943 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:57:18.553114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:57:18.553797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=30 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:57:18.560223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:57:18.560723 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:57:18.561170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:57:18.561882 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:57:18.562333 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:57:18.562754 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:57:18.854858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-668ef1d4-9962-4ef7-9300-6e3d254b94c4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "POST /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311034 Sep 26 05:57:18.855572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 519/1032] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:57:18 2022] POST /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:58:05.663571 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=16 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:05.664345 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=36 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:05.665498 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 05:58:05.665682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 05:58:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e/os-volume_attachments/40ad2629-a15b-4365-b52f-06163e3f6129 (ip 10.222.0.57) !!! Sep 26 05:58:05.673179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:05.673691 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:05.684973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:05.685415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:05.685845 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:05.686539 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:05.686993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:05.687408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:05.774480 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lazy-loading 'services' on Instance uuid e90c4336-6231-427f-8fc1-ef229a795a4e {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:58:05.854407 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a4df8a4e-da8a-47a4-8a17-b816f9b4397b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e/os-volume_attachments/40ad2629-a15b-4365-b52f-06163e3f6129" status: 202 len: 0 microversion: 2.1 time: 0.192286 Sep 26 05:58:05.855030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 514/1033] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:58:05 2022] DELETE /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e/os-volume_attachments/40ad2629-a15b-4365-b52f-06163e3f6129 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:58:07.004066 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:07.004635 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:07.007685 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 05:58:07.007834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 05:58:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e (ip 10.222.0.57) !!! Sep 26 05:58:07.009607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:07.010300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:07.017519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:07.018002 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:07.018435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:07.019149 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:07.019585 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:07.019998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:07.049511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:58:07.150475 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c778decb-2547-41a5-9832-be2d288b19f0 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 204 len: 0 microversion: 2.1 time: 0.149114 Sep 26 05:58:07.151446 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 520/1034] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:58:06 2022] DELETE /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:58:07.163048 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:07.163800 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:07.172914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:07.172914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:07.172914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:07.172914 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:07.173630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:07.173630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:07.310386 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:07.318461 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-358ab0bd-659a-428e-9f2e-00dfbb724a62 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1514 microversion: 2.1 time: 0.161574 Sep 26 05:58:07.319024 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 515/1035] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:07 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:08.350458 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:08.351144 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:08.357821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:08.358300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:08.358727 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:08.359417 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:08.359845 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:08.360252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:08.496284 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:08.507667 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4133c8c1-b2ce-4116-8608-f0c50b07419d tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1514 microversion: 2.1 time: 0.161403 Sep 26 05:58:08.508440 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 521/1036] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:08 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:09.534091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:09.534983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:09.542791 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:09.543476 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:09.544093 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:09.544894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:09.545545 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:09.546037 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:09.741867 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:09.750177 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-48e7955b-4706-4f00-9658-304f91bc09a5 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 200 len: 1514 microversion: 2.1 time: 0.221642 Sep 26 05:58:09.750774 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 516/1037] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:09 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:09.865950 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-1dbc4996-fef4-4cc8-9201-f863b72bb181 req-e556dc2d-76ef-46dc-9e13-9994a07498b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e90c4336-6231-427f-8fc1-ef229a795a4e", "name": "network-vif-deleted", "tag": "43477020-5aa0-47f6-86e5-ff2f91441d05"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:58:09.876046 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1dbc4996-fef4-4cc8-9201-f863b72bb181 req-e556dc2d-76ef-46dc-9e13-9994a07498b5 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:09.876521 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1dbc4996-fef4-4cc8-9201-f863b72bb181 req-e556dc2d-76ef-46dc-9e13-9994a07498b5 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:09.876945 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-1dbc4996-fef4-4cc8-9201-f863b72bb181 req-e556dc2d-76ef-46dc-9e13-9994a07498b5 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:09.888609 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-1dbc4996-fef4-4cc8-9201-f863b72bb181 req-e556dc2d-76ef-46dc-9e13-9994a07498b5 service nova] Creating event network-vif-deleted:43477020-5aa0-47f6-86e5-ff2f91441d05 for instance e90c4336-6231-427f-8fc1-ef229a795a4e on hv-cinder-83608 Sep 26 05:58:09.893881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-1dbc4996-fef4-4cc8-9201-f863b72bb181 req-e556dc2d-76ef-46dc-9e13-9994a07498b5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031432 Sep 26 05:58:09.895218 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 522/1038] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:58:10.777957 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:10.778747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: e90c4336-6231-427f-8fc1-ef229a795a4e] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:10.788548 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:10.789339 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:10.789974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:10.791020 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:10.791747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:10.792290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:10.806907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] HTTP exception thrown: Instance e90c4336-6231-427f-8fc1-ef229a795a4e could not be found. Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Request method failure captured: Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e HTTP/1.1 Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT8LXvVCl3NbxC97UJHa_KlFSvH_u60yFiKcMhDO8XpZI4XAsEQ4AFb6zZF-l_Htd5-G1J4Hgzt2dE3R0eqWvcH2uyW4JavQXfZMP6lFRsKWJz0SpS3VvkS5tfrkmtOs88xz-zeZou41VOG3Y-1KXUKtqYnqxmCf73oYyHGtaSFxoGY Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: fa25b13404c54cff94e3c12198e9c313 Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2119734382 Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:58:10.808603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa25b13404c54cff94e3c12198e9c313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa25b13404c54cff94e3c12198e9c313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa25b13404c54cff94e3c12198e9c313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa25b13404c54cff94e3c12198e9c313", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesSnapshotTestJSON-2119734382 Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: fa25b13404c54cff94e3c12198e9c313 Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2119734382 Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesSnapshotTestJSON-2119734382-project Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 00928159647d47d6b324c0c11231465e Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesSnapshotTestJSON-2119734382-project Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance e90c4336-6231-427f-8fc1-ef229a795a4e could not be found. Sep 26 05:58:10.810326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'e90c4336-6231-427f-8fc1-ef229a795a4e'} Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e90c4336-6231-427f-8fc1-ef229a795a4e could not be found. Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:58:10.811336 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e90c4336-6231-427f-8fc1-ef229a795a4e could not be found. Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e90c4336-6231-427f-8fc1-ef229a795a4e could not be found. Sep 26 05:58:10.813251 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:58:10.814711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Returning 404 to user: Instance e90c4336-6231-427f-8fc1-ef229a795a4e could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:58:10.814711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-70ebda5c-3c0b-4bf1-9c73-cd229960a5b4 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e" status: 404 len: 111 microversion: 2.1 time: 0.038527 Sep 26 05:58:10.814711 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 517/1039] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:10 2022] GET /compute/v2.1/servers/e90c4336-6231-427f-8fc1-ef229a795a4e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:58:26.027122 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:26.028317 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:26.033197 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-154603766", "imageRef": "7fb7419d-4f5c-4447-8c57-b5a8e8347376", "flavorRef": "452", "networks": [{"uuid": "033e951b-5e4f-4458-a303-5df31393f5da"}]}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:58:26.155424 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] validate_networks() for [('033e951b-5e4f-4458-a303-5df31393f5da', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:58:27.170689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:58:27.171899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:58:27.172574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:58:27.173848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:58:27.174993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:58:27.195247 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:27.195739 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:27.196177 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:27.196905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:27.201733 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:27.202646 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:27.248654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Getting quotas for project fa25b13404c54cff94e3c12198e9c313. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:58:27.265594 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Getting quotas for user 00928159647d47d6b324c0c11231465e and project fa25b13404c54cff94e3c12198e9c313. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:58:27.297430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:58:27.307967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7fb7419d-4f5c-4447-8c57-b5a8e8347376',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:58:27.409276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-027c2542-e165-4d40-ba1d-46ac760265fb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383892 Sep 26 05:58:27.411647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 523/1040] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:58:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:58:27.426464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3cf4d2e4-2bbc-46ce-8969-f9f259660a34 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:27.428346 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3cf4d2e4-2bbc-46ce-8969-f9f259660a34 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:27.448128 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=8 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:27.453930 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:27.685717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3cf4d2e4-2bbc-46ce-8969-f9f259660a34 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:27.694073 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3cf4d2e4-2bbc-46ce-8969-f9f259660a34 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1218 microversion: 2.1 time: 0.276032 Sep 26 05:58:27.706213 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 518/1041] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:27 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:28.720311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:28.721700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:28.730953 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:28.731848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:28.732526 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:28.733605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:28.734136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:28.734837 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:28.989286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:29.009422 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0f991eb5-b1b1-4f04-a398-b694e1255951 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1270 microversion: 2.1 time: 0.292746 Sep 26 05:58:29.011058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 524/1042] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:28 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1270 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:29.749158 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-32283b1b-55c1-48cc-8b48-067f1ac8e37a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Action: 'create', calling method: .version_select at 0x7f1e5e5bfc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1182630542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIqdt+RuBoV9bZ14/aEdT0LNqdDjtZ5HBBUCCGeiHW7cfOqqLtxJU22lbZIwlxlaTW6buKB4LYAcXMyi0xKYlmv+W4Che7/DEdvW2ITj7V9Xw5T/Sg2PJBg+W3AiflMwQ=="}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:58:29.766574 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-32283b1b-55c1-48cc-8b48-067f1ac8e37a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Getting quotas for project 098526f06e1a43fa9e94e805f72fed14. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:58:29.770835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-32283b1b-55c1-48cc-8b48-067f1ac8e37a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Getting quotas for user 7734565b147c40bebfeea7e093abc393 and project 098526f06e1a43fa9e94e805f72fed14. Resources: {'key_pairs'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:58:29.796014 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-32283b1b-55c1-48cc-8b48-067f1ac8e37a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.246604 Sep 26 05:58:29.797425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 519/1043] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 05:58:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:58:30.032876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:30.033519 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:30.039967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:30.040452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:30.040879 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:30.041759 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:30.042248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:30.042672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:30.218378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:30.230047 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f4e416b5-b9d4-41bb-9600-ae3a519def7c tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.201097 Sep 26 05:58:30.230749 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 525/1044] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:30 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:30.925436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-c8315dc2-e86e-4904-8aa2-7d259a458ed1 req-abea0431-9400-4b34-83aa-2020ed813efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a76f2eed-969b-4d1c-b2a7-70d91268c648", "tag": "12d9bd18-bd59-4b97-be2e-95f11cd067a5"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:58:30.942151 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c8315dc2-e86e-4904-8aa2-7d259a458ed1 req-abea0431-9400-4b34-83aa-2020ed813efa service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:30.943014 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c8315dc2-e86e-4904-8aa2-7d259a458ed1 req-abea0431-9400-4b34-83aa-2020ed813efa service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:30.943651 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c8315dc2-e86e-4904-8aa2-7d259a458ed1 req-abea0431-9400-4b34-83aa-2020ed813efa service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:30.956949 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-c8315dc2-e86e-4904-8aa2-7d259a458ed1 req-abea0431-9400-4b34-83aa-2020ed813efa service nova] Creating event network-changed:12d9bd18-bd59-4b97-be2e-95f11cd067a5 for instance a76f2eed-969b-4d1c-b2a7-70d91268c648 on hv-cinder-83608 Sep 26 05:58:30.964470 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-c8315dc2-e86e-4904-8aa2-7d259a458ed1 req-abea0431-9400-4b34-83aa-2020ed813efa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044212 Sep 26 05:58:30.967805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 520/1045] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:58:31.253524 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:31.254831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:31.261620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:31.262395 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:31.263066 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:31.264306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:31.264993 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:31.266335 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:31.446141 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:31.457604 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f147d984-52ff-45f6-b0d8-ff4b7374f12e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.207875 Sep 26 05:58:31.458193 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 526/1046] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:31 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:32.483013 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:32.483713 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:32.490714 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:32.491238 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:32.491798 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:32.492377 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:32.492831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:32.493301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:32.639203 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:32.650030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8c392d06-883b-47e5-9f9d-32fa41355c09 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.171497 Sep 26 05:58:32.650740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 521/1047] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:32 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:33.676250 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:33.676825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:33.684159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:33.684961 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:33.685632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:33.686355 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:33.686792 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:33.687211 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:33.838038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:33.845955 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f4bf5f23-2588-4078-8373-da9f57b49937 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.173761 Sep 26 05:58:33.846522 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 527/1048] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:33 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:34.868242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:34.868910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:34.875494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:34.875982 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:34.876415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:34.877151 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:34.877618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:34.878038 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:35.017883 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:35.026771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-29a8ac00-f44f-4971-85f5-2d1d1c5e9fbb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.162428 Sep 26 05:58:35.027341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 522/1049] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:34 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:36.054611 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:36.055852 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:36.065699 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:36.066160 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:36.066819 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:36.068053 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:36.068507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:36.068932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:36.216751 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:36.227800 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ec927b79-ce91-4387-b194-e57e171081aa tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.179311 Sep 26 05:58:36.228589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 528/1050] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:36 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:36.566586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-c6cc7645-c455-4bfc-aba4-106497576573 req-3b1dca4d-c52a-4605-a4d4-c5ceaa397927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76f2eed-969b-4d1c-b2a7-70d91268c648", "name": "network-vif-plugged", "status": "completed", "tag": "12d9bd18-bd59-4b97-be2e-95f11cd067a5"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:58:36.577070 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c6cc7645-c455-4bfc-aba4-106497576573 req-3b1dca4d-c52a-4605-a4d4-c5ceaa397927 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:36.577555 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c6cc7645-c455-4bfc-aba4-106497576573 req-3b1dca4d-c52a-4605-a4d4-c5ceaa397927 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:36.578226 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c6cc7645-c455-4bfc-aba4-106497576573 req-3b1dca4d-c52a-4605-a4d4-c5ceaa397927 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:36.590064 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-c6cc7645-c455-4bfc-aba4-106497576573 req-3b1dca4d-c52a-4605-a4d4-c5ceaa397927 service nova] Creating event network-vif-plugged:12d9bd18-bd59-4b97-be2e-95f11cd067a5 for instance a76f2eed-969b-4d1c-b2a7-70d91268c648 on hv-cinder-83608 Sep 26 05:58:36.595086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-c6cc7645-c455-4bfc-aba4-106497576573 req-3b1dca4d-c52a-4605-a4d4-c5ceaa397927 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091840 Sep 26 05:58:36.595681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 523/1051] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:58:37.256911 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:37.257571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:37.260860 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:37.270217 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:37.271007 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:37.271444 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:37.272276 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:37.272729 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:37.273159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:37.289381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=6 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:37.424502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:37.433318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a0a1b2d4-abc0-4045-b4c4-5887fc29bacc tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.183174 Sep 26 05:58:37.433932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 529/1052] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:37 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:38.457970 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:38.458751 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:38.465288 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:38.465760 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:38.466188 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:38.466851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:38.467300 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:38.467716 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:38.611469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:38.621083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a6c5af39-9ded-4542-b099-d1a77fa23d02 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1318 microversion: 2.1 time: 0.167942 Sep 26 05:58:38.621827 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 524/1053] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:38 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:39.645018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:58:39.645637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:39.652643 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:39.653127 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:39.653581 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:39.654262 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:39.654715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:39.655262 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:39.800340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:58:39.809183 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d827f228-bff9-4ca8-aa23-c9e99a743c41 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1508 microversion: 2.1 time: 0.168135 Sep 26 05:58:39.809784 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 530/1054] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:58:39 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:58:39.835749 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fa6465-efe6-4e37-9e7e-8ebcc7d8c16c", "device": "/dev/sdb"}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:58:39.838916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:58:39.841479 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=6 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:39.847629 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:39.848121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:39.848555 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:39.849294 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:58:39.849754 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:58:39.850175 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:58:40.154047 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6a6e400f-3039-40bd-a11b-5deed713580e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "POST /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322464 Sep 26 05:58:40.154687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 525/1055] 10.222.0.57 () {60 vars in 1323 bytes} [Mon Sep 26 05:58:39 2022] POST /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 05:59:01.355438 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-312934149", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1182630542", "security_groups": [{"name": "tempest-secgroup-smoke-1363547104"}], "networks": [{"uuid": "e0a86aaa-de96-403a-a0a0-65f968e4c5e5"}], "block_device_mapping_v2": [{"uuid": "a12b37c0-d447-4e4c-9b8b-e635bd055403", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:59:01.366337 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:01.366998 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=44 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:01.474695 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.network.neutron [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] validate_networks() for [('e0a86aaa-de96-403a-a0a0-65f968e4c5e5', None, None, None, None, None)] {{(pid=127274) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 05:59:01.894599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Flavor limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 05:59:01.895029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Image limits 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 05:59:01.895496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Flavor pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 05:59:01.895898 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Image pref 0:0:0 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 05:59:01.896308 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.virt.hardware [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127274) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 05:59:01.905090 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:01.905606 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:01.906037 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:01.906758 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:01.907207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:01.907625 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:01.924452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Getting quotas for project 098526f06e1a43fa9e94e805f72fed14. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 05:59:01.928286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Getting quotas for user 7734565b147c40bebfeea7e093abc393 and project 098526f06e1a43fa9e94e805f72fed14. Resources: {'cores', 'ram', 'instances'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 05:59:01.988237 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Going to run 1 instances... {{(pid=127274) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 05:59:01.990397 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a12b37c0-d447-4e4c-9b8b-e635bd055403',volume_size=None,volume_type=None)] {{(pid=127274) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 05:59:02.125578 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-472f43a7-98cb-4940-8dc0-c3fd675b8b81 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774073 Sep 26 05:59:02.126328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 531/1056] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 05:59:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 05:59:02.136832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:02.138369 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:02.143318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6cc97490-2efc-4b05-ab38-4e182a4c0658 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:02.146628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6cc97490-2efc-4b05-ab38-4e182a4c0658 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:02.212522 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6cc97490-2efc-4b05-ab38-4e182a4c0658 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:02.220347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6cc97490-2efc-4b05-ab38-4e182a4c0658 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1088 microversion: 2.1 time: 0.085233 Sep 26 05:59:02.220904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 526/1057] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:02 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:03.243859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:03.244505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:03.251632 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:03.252146 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:03.252571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:03.253374 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:03.253833 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:03.254248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:03.320721 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:03.330191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-86e13e57-cda1-4b0e-9099-a17872f51788 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1186 microversion: 2.1 time: 0.090703 Sep 26 05:59:03.330973 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 532/1058] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:03 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:03.809325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:03.809897 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:03.817976 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:03.818466 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:03.818903 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:03.819558 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:03.820030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:03.820428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:03.909683 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lazy-loading 'services' on Instance uuid a76f2eed-969b-4d1c-b2a7-70d91268c648 {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 05:59:03.986990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-bc9ae815-9289-4024-95b0-38d24c1b639e tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648/os-volume_attachments/e9fa6465-efe6-4e37-9e7e-8ebcc7d8c16c" status: 202 len: 0 microversion: 2.1 time: 0.182089 Sep 26 05:59:03.987896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 527/1059] 10.222.0.57 () {58 vars in 1416 bytes} [Mon Sep 26 05:59:03 2022] DELETE /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648/os-volume_attachments/e9fa6465-efe6-4e37-9e7e-8ebcc7d8c16c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 05:59:04.354629 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:04.355198 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:04.362329 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:04.362852 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:04.363248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:04.363944 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:04.364394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:04.364796 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:04.498304 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:04.507294 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d5a8922e-4828-46a6-915e-3cbbaf4ff7ee tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1272 microversion: 2.1 time: 0.156461 Sep 26 05:59:04.508095 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 533/1060] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:04 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:05.138027 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:05.138634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:05.144907 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:05.145441 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:05.145879 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:05.146632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:05.147034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:05.147455 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:05.173319 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ccff528e-2526-443a-a5e0-6cb3e76db6be req-28f14951-b53c-4556-83b4-2786bd539cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03274ff5-16a4-468b-a4bc-4a320240179f", "tag": "a2005324-0611-48ff-9c1d-d25f11767b64"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:59:05.173926 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 05:59:05.194357 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ccff528e-2526-443a-a5e0-6cb3e76db6be req-28f14951-b53c-4556-83b4-2786bd539cfb service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:05.195221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ccff528e-2526-443a-a5e0-6cb3e76db6be req-28f14951-b53c-4556-83b4-2786bd539cfb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:05.195831 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ccff528e-2526-443a-a5e0-6cb3e76db6be req-28f14951-b53c-4556-83b4-2786bd539cfb service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:05.209874 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ccff528e-2526-443a-a5e0-6cb3e76db6be req-28f14951-b53c-4556-83b4-2786bd539cfb service nova] Creating event network-changed:a2005324-0611-48ff-9c1d-d25f11767b64 for instance 03274ff5-16a4-468b-a4bc-4a320240179f on hv-cinder-83608 Sep 26 05:59:05.220472 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ccff528e-2526-443a-a5e0-6cb3e76db6be req-28f14951-b53c-4556-83b4-2786bd539cfb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051027 Sep 26 05:59:05.221291 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 534/1061] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:59:05.264502 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a655b521-7238-4faa-914f-73dd16105aaf tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "DELETE /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 204 len: 0 microversion: 2.1 time: 0.130634 Sep 26 05:59:05.265266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 528/1062] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 05:59:05 2022] DELETE /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 05:59:05.275124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:05.275826 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:05.282389 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:05.282885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:05.283318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:05.284082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:05.284567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:05.284988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:05.429603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:05.437770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e373d87a-40ae-4ef4-b9c3-07ca6b0fe9b1 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1514 microversion: 2.1 time: 0.167450 Sep 26 05:59:05.438452 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 535/1063] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:05 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:05.532055 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:05.532723 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:05.539179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:05.539662 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:05.540084 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:05.540766 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:05.541246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:05.541657 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:05.694647 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:05.706838 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6cb96480-7271-4a2e-acf0-10e70136fcb7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.178600 Sep 26 05:59:05.706838 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 529/1064] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:05 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:06.466506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:06.467786 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:06.478474 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:06.479307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:06.479988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:06.481173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:06.481881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:06.482586 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:06.634356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:06.642639 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7b215056-fc14-4de0-a1b1-e14e7d5c2edb tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1514 microversion: 2.1 time: 0.182488 Sep 26 05:59:06.643181 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 536/1065] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:06 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:06.730262 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:06.731164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:06.738333 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:06.739103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:06.739797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:06.740892 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:06.741671 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:06.742252 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:07.129288 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:07.141124 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0efe5d1a-8b69-4000-bb7e-974dbd2af63a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.414479 Sep 26 05:59:07.141916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 530/1066] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:06 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:07.668802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:07.669591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:07.677827 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:07.678436 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:07.678980 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:07.679847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:07.680413 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:07.680943 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:07.822401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:07.832969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-caa901dc-a5f0-4eeb-8d6f-6f8aa2a92fa3 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1514 microversion: 2.1 time: 0.169770 Sep 26 05:59:07.833929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 537/1067] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:07 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:08.165085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:08.165832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:08.172869 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:08.173402 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:08.173957 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:08.174668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:08.175121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:08.175552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:08.745236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:08.753715 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2572a0b4-58dd-493d-bdf4-89c516f3c945 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.592459 Sep 26 05:59:08.754306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 531/1068] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:08 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:08.856358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:08.857048 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:08.864171 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:08.864664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:08.865076 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:08.865836 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:08.866317 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:08.866770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:09.008557 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00928159647d47d6b324c0c11231465e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa25b13404c54cff94e3c12198e9c313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:09.016769 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-38782486-9d1c-411b-b33e-05ad7fde037b tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 200 len: 1514 microversion: 2.1 time: 0.164609 Sep 26 05:59:09.017344 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 538/1069] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:08 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:09.182687 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-49402fff-cee6-4f4d-a4bd-0a34a749843d req-92c1c0a8-0b35-43ed-9cf7-c7c38a4211c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a76f2eed-969b-4d1c-b2a7-70d91268c648", "name": "network-vif-deleted", "tag": "12d9bd18-bd59-4b97-be2e-95f11cd067a5"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:59:09.198606 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-49402fff-cee6-4f4d-a4bd-0a34a749843d req-92c1c0a8-0b35-43ed-9cf7-c7c38a4211c3 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:09.199139 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-49402fff-cee6-4f4d-a4bd-0a34a749843d req-92c1c0a8-0b35-43ed-9cf7-c7c38a4211c3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:09.199648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-49402fff-cee6-4f4d-a4bd-0a34a749843d req-92c1c0a8-0b35-43ed-9cf7-c7c38a4211c3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:09.212042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-49402fff-cee6-4f4d-a4bd-0a34a749843d req-92c1c0a8-0b35-43ed-9cf7-c7c38a4211c3 service nova] Creating event network-vif-deleted:12d9bd18-bd59-4b97-be2e-95f11cd067a5 for instance a76f2eed-969b-4d1c-b2a7-70d91268c648 on hv-cinder-83608 Sep 26 05:59:09.217644 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-49402fff-cee6-4f4d-a4bd-0a34a749843d req-92c1c0a8-0b35-43ed-9cf7-c7c38a4211c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038482 Sep 26 05:59:09.218801 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 532/1070] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:59:09.779433 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:09.780224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:09.787421 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:09.787989 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:09.788430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:09.789121 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:09.789605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:09.790029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:09.927317 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:09.935486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d7b87034-b317-4448-bcf4-4bb2a05ba304 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.161876 Sep 26 05:59:09.936051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 539/1071] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:09 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:10.043129 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:10.044051 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] [instance: a76f2eed-969b-4d1c-b2a7-70d91268c648] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:10.052847 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:10.053540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:10.054112 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:10.055022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:10.055621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:10.056175 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:10.071951 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] HTTP exception thrown: Instance a76f2eed-969b-4d1c-b2a7-70d91268c648 could not be found. Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Request method failure captured: Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 HTTP/1.1 Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMT8LXvVCl3NbxC97UJHa_KlFSvH_u60yFiKcMhDO8XpZI4XAsEQ4AFb6zZF-l_Htd5-G1J4Hgzt2dE3R0eqWvcH2uyW4JavQXfZMP6lFRsKWJz0SpS3VvkS5tfrkmtOs88xz-zeZou41VOG3Y-1KXUKtqYnqxmCf73oYyHGtaSFxoGY Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: fa25b13404c54cff94e3c12198e9c313 Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2119734382 Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 05:59:10.073627 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa25b13404c54cff94e3c12198e9c313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa25b13404c54cff94e3c12198e9c313"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa25b13404c54cff94e3c12198e9c313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa25b13404c54cff94e3c12198e9c313", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-VolumesSnapshotTestJSON-2119734382 Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: fa25b13404c54cff94e3c12198e9c313 Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2119734382 Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-VolumesSnapshotTestJSON-2119734382-project Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: 00928159647d47d6b324c0c11231465e Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-VolumesSnapshotTestJSON-2119734382-project Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance a76f2eed-969b-4d1c-b2a7-70d91268c648 could not be found. Sep 26 05:59:10.075343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': 'a76f2eed-969b-4d1c-b2a7-70d91268c648'} Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a76f2eed-969b-4d1c-b2a7-70d91268c648 could not be found. Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 05:59:10.076682 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a76f2eed-969b-4d1c-b2a7-70d91268c648 could not be found. Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a76f2eed-969b-4d1c-b2a7-70d91268c648 could not be found. Sep 26 05:59:10.078974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 05:59:10.080325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] Returning 404 to user: Instance a76f2eed-969b-4d1c-b2a7-70d91268c648 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 05:59:10.080325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-19e649ac-5d16-4a41-b97e-b3037972def2 tempest-VolumesSnapshotTestJSON-2119734382 tempest-VolumesSnapshotTestJSON-2119734382-project] 10.222.0.57 "GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648" status: 404 len: 111 microversion: 2.1 time: 0.037900 Sep 26 05:59:10.080325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 533/1072] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:10 2022] GET /compute/v2.1/servers/a76f2eed-969b-4d1c-b2a7-70d91268c648 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 05:59:10.959658 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:10.960289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:10.966873 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:10.967349 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:10.967771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:10.968453 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:10.968890 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:10.969345 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:11.167914 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:11.176318 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-8c662c2d-db4b-49c0-93ce-924d2284d36a tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.220695 Sep 26 05:59:11.176851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 540/1073] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:10 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:12.200202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:12.201306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:12.208540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:12.209040 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:12.209510 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:12.210219 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:12.210681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:12.211103 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:12.227385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:12.353164 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:12.361107 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6ed9d3ff-1b42-4bfe-8e7d-35fac6c18e41 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.164862 Sep 26 05:59:12.361814 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 534/1074] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:12 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:13.385759 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:13.386414 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:13.389195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:13.389984 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=6 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:13.396943 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:13.397487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:13.397923 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:13.398624 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:13.399080 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:13.399498 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:13.537128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:13.545339 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ad909fa0-4599-4524-9844-79a6452d355d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.164445 Sep 26 05:59:13.545903 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 541/1075] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:13 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:14.568196 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:14.568808 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:14.575753 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:14.576599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:14.577036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:14.577764 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:14.578216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:14.578637 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:14.724516 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:14.732936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8328e5a0-5f02-4a90-b67d-5ccdb87d3732 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.168668 Sep 26 05:59:14.733513 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 535/1076] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:14 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:15.756138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:15.756768 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:15.763659 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:15.764133 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:15.764559 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:15.765273 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:15.765718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:15.766126 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:15.914507 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:15.924310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-50fbe176-188c-4046-abdd-7c59adb1746d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.172105 Sep 26 05:59:15.925089 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 542/1077] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:15 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:16.946851 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:16.947550 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:16.954296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:16.955043 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:16.955465 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:16.956160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:16.956624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:16.957060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:17.113042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:17.131868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f3a5b2d8-a506-4c16-998d-5c1c9c3979dd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.188599 Sep 26 05:59:17.133096 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 536/1078] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:16 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:18.159133 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:18.159746 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:18.166698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:18.167194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:18.167628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:18.168338 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:18.168792 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:18.169223 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:18.302722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:18.312170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-bfd787f4-637f-463c-b59e-64c7240927e1 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.156919 Sep 26 05:59:18.312744 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 543/1079] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:18 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:18.724823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-9042b433-c23f-4855-a678-25b8ff92a902 req-a8269edc-c625-4807-a3a1-76fb2f85315d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03274ff5-16a4-468b-a4bc-4a320240179f", "name": "network-vif-plugged", "status": "completed", "tag": "a2005324-0611-48ff-9c1d-d25f11767b64"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:59:18.735012 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-9042b433-c23f-4855-a678-25b8ff92a902 req-a8269edc-c625-4807-a3a1-76fb2f85315d service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:18.735484 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-9042b433-c23f-4855-a678-25b8ff92a902 req-a8269edc-c625-4807-a3a1-76fb2f85315d service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:18.735899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-9042b433-c23f-4855-a678-25b8ff92a902 req-a8269edc-c625-4807-a3a1-76fb2f85315d service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:18.748007 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-9042b433-c23f-4855-a678-25b8ff92a902 req-a8269edc-c625-4807-a3a1-76fb2f85315d service nova] Creating event network-vif-plugged:a2005324-0611-48ff-9c1d-d25f11767b64 for instance 03274ff5-16a4-468b-a4bc-4a320240179f on hv-cinder-83608 Sep 26 05:59:18.753434 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-9042b433-c23f-4855-a678-25b8ff92a902 req-a8269edc-c625-4807-a3a1-76fb2f85315d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032296 Sep 26 05:59:18.757341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 537/1080] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 05:59:19.336960 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:19.337543 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:19.345197 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:19.345752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:19.346235 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:19.346995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:19.347502 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:19.347954 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:19.484271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:19.492274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5dad031a-4569-42cd-aabf-a7f3d0923a61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1260 microversion: 2.1 time: 0.160033 Sep 26 05:59:19.492843 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 544/1081] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:19 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:20.517869 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:20.518464 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:20.525228 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:20.525725 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:20.526160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:20.526858 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:20.527318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:20.527742 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:20.671039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:20.681053 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-02bfe91a-8185-4718-96eb-d9de2eafb02d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1443 microversion: 2.1 time: 0.168190 Sep 26 05:59:20.681663 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 538/1082] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:20 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:20.705391 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 05:59:20.706009 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 05:59:20.712792 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:20.713311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:20.713741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:20.714434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:20.714885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:20.715310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:20.858046 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 05:59:20.866050 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a01b3132-84f8-444e-81ff-37ca5703ac58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1443 microversion: 2.1 time: 0.165161 Sep 26 05:59:20.866755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 545/1083] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 05:59:20 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 05:59:22.680972 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-894287a9-e2db-41a7-b36c-9b0ee82f4e63 req-6261c193-394b-46c9-a6cb-b5b86d4fbb4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03274ff5-16a4-468b-a4bc-4a320240179f", "tag": "a2005324-0611-48ff-9c1d-d25f11767b64"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 05:59:22.691138 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-894287a9-e2db-41a7-b36c-9b0ee82f4e63 req-6261c193-394b-46c9-a6cb-b5b86d4fbb4a service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 05:59:22.691511 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-894287a9-e2db-41a7-b36c-9b0ee82f4e63 req-6261c193-394b-46c9-a6cb-b5b86d4fbb4a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 05:59:22.691931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-894287a9-e2db-41a7-b36c-9b0ee82f4e63 req-6261c193-394b-46c9-a6cb-b5b86d4fbb4a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 05:59:22.704685 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-894287a9-e2db-41a7-b36c-9b0ee82f4e63 req-6261c193-394b-46c9-a6cb-b5b86d4fbb4a service nova] Creating event network-changed:a2005324-0611-48ff-9c1d-d25f11767b64 for instance 03274ff5-16a4-468b-a4bc-4a320240179f on hv-cinder-83608 Sep 26 05:59:22.709848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-894287a9-e2db-41a7-b36c-9b0ee82f4e63 req-6261c193-394b-46c9-a6cb-b5b86d4fbb4a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086467 Sep 26 05:59:22.710598 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 539/1084] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 05:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:01:38.044371 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 26 06:01:38.045123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:38.045800 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=82 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:38.047006 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:01:38.047285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 06:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f/action (ip 10.222.0.57) !!! Sep 26 06:01:38.048637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:01:38.048802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 06:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f/action (ip 10.222.0.57) !!! Sep 26 06:01:38.053828 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:01:38.054356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:38.064297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:38.065091 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:38.065547 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:38.066244 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:38.066689 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:38.067103 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:38.093933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.objects.instance [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lazy-loading 'flavor' on Instance uuid 03274ff5-16a4-468b-a4bc-4a320240179f {{(pid=127274) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 06:01:38.176864 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-d2bade0a-9a2e-413b-81bf-b435a5c49a58 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "POST /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f/action" status: 202 len: 0 microversion: 2.1 time: 0.134915 Sep 26 06:01:38.177546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 546/1085] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 06:01:38 2022] POST /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 06:01:38.186279 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9c2cd27-7bfb-4103-aa4c-09fff6db273b] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 06:01:38.186939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:38.187765 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:38.189748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:01:38.189962 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 06:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f (ip 10.222.0.57) !!! Sep 26 06:01:38.191473 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:01:38.191913 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 06:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f (ip 10.222.0.57) !!! Sep 26 06:01:38.200458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:38.201218 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:38.213456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:38.213953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:38.214393 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:38.215102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:38.215562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:38.216010 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:38.357527 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:38.369945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a3d0e587-9aed-4424-aaa6-d2d912a0a0ed tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.185166 Sep 26 06:01:38.370540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 540/1086] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:38 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:39.395661 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:39.396293 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:39.408375 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:39.409210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:39.409910 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:39.411015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:39.411718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:39.412405 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:39.419424 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48058. Sep 26 06:01:39.829362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:39.841179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7ab37890-8a19-440d-8895-a7a58ffbfb54 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.450634 Sep 26 06:01:39.841819 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 547/1087] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:39 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:40.867173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:40.868202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:40.880102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:40.880898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:40.881654 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:40.882770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:40.883493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:40.884221 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:40.890469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9c2cd27-7bfb-4103-aa4c-09fff6db273b] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48064. Sep 26 06:01:41.029852 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:41.038376 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7c88412d-3d9f-4207-ba3a-cf28c2741b18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.177011 Sep 26 06:01:41.038958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 541/1088] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:40 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:42.063363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:42.064075 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:42.071365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:42.071851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:42.072306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:42.073123 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:42.074003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:42.074415 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:42.225676 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:42.234011 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ebd6e6e5-9f11-476f-919c-522f9a4065d0 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.174769 Sep 26 06:01:42.234584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 548/1089] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:42 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:43.260519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:43.261344 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:43.271902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:43.272516 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:43.272942 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:43.274125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:43.274704 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:43.275314 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:43.418357 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:43.426921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9d4ec4f6-8949-41e7-ab06-367e3d81a9c7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.172699 Sep 26 06:01:43.427492 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 542/1090] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:43 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:44.451459 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:44.452065 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:44.458976 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:44.459466 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:44.459899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:44.460602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:44.461054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:44.461514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:44.610607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:44.619332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a2ae94b9-167b-4386-affe-ead744070e0b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.172424 Sep 26 06:01:44.620087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 549/1091] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:44 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:45.644253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:45.646127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:45.656095 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:45.656668 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:45.657437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:45.658329 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:45.659091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:45.659782 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:45.804818 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:45.817436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4849d3c8-6b57-4b54-b322-6e5792c7b8f3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.177074 Sep 26 06:01:45.818229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 543/1092] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:45 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:46.844571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:46.845546 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:46.852815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:46.853343 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:46.853770 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:46.854482 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:46.854936 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:46.855352 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:46.993315 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:47.001892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fbb2122a-e996-440d-bca6-384b9b310932 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.161465 Sep 26 06:01:47.002485 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 550/1093] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:46 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:48.026094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:48.026746 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:48.034382 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:48.034852 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:48.035287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:48.036001 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:48.036462 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:48.036886 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:48.177253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:48.185734 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-361c6f5a-bfde-4b3f-91f1-66ce27096b6f tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.163500 Sep 26 06:01:48.186325 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 544/1094] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:48 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:49.211150 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:49.211841 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:49.219227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:49.219629 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:49.220059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:49.220764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:49.221246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:49.221650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:49.367959 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:49.376031 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-07314ccb-cab7-48d4-b2b8-bd849476dd2b tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.168962 Sep 26 06:01:49.376605 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 551/1095] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:49 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:50.399924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:50.400575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:50.407634 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:50.408121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:50.408545 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:50.409266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:50.409717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:50.410134 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:50.564873 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:50.572881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-fbb85e5a-1876-4113-a2ed-7ec31017fc52 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.176906 Sep 26 06:01:50.573828 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 545/1096] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:50 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:51.606314 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:51.607060 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:51.614179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:51.614669 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:51.615109 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:51.615809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:51.616263 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:51.616743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:51.755131 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:51.763319 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e66db479-eb94-463d-8c0c-8c94c6591d74 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.162917 Sep 26 06:01:51.763881 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 552/1097] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:51 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:52.789904 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:52.790664 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:52.804344 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:52.806085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:52.806697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:52.807588 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:52.808327 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:52.808927 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:52.956755 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:52.969003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-eb0f3f24-b4c9-4fac-b9bc-9b34b19b60c5 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.184306 Sep 26 06:01:52.970454 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 546/1098] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:52 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:53.992815 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:53.993487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:54.003741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:54.004456 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:54.004997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:54.006168 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:54.006849 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:54.007551 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:54.153023 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:54.161054 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-cf32af88-c599-45eb-ad42-27b583d8871e tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.172300 Sep 26 06:01:54.161663 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 553/1099] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:53 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:55.185262 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:55.186163 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:55.196586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:55.197290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:55.197958 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:55.199431 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:55.200183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:55.200883 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:55.341349 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:55.349936 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-41ded55b-a783-451d-b09b-50943cd5dbf3 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.169139 Sep 26 06:01:55.350533 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 547/1100] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:55 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:56.374426 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:56.375086 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:56.382074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:56.382555 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:56.382981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:56.383700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:56.384148 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:56.384529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:56.535686 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:56.544644 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-910164ef-b22c-44de-b7b5-9cefbce544d7 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1569 microversion: 2.1 time: 0.174297 Sep 26 06:01:56.545986 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 554/1101] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:56 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:56.568735 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:01:56.569374 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:56.576757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:56.577266 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:56.578111 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:56.578278 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:56.578708 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:56.579132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:56.622421 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127275) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 06:01:56.696640 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-579c5784-af1b-4ab4-9b38-2ead1b3683ad tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "POST /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f/action" status: 202 len: 0 microversion: 2.1 time: 0.132020 Sep 26 06:01:56.697405 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 548/1102] 10.222.0.57 () {60 vars in 1278 bytes} [Mon Sep 26 06:01:56 2022] POST /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 06:01:56.706572 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:56.707173 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:56.714653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:56.715147 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:56.715576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:56.716315 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:56.716919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:56.717409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:56.882396 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:56.895138 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-982be401-8166-4140-be3f-2d18f53637db tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1517 microversion: 2.1 time: 0.192368 Sep 26 06:01:56.896036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 555/1103] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:56 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:57.925693 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:57.926332 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:57.933992 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:57.934496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:57.934932 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:57.935681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:57.936134 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:57.936560 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:58.086193 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:58.095290 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-0539b04b-15bb-4eba-9c70-f342e468036c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1519 microversion: 2.1 time: 0.175715 Sep 26 06:01:58.095868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 549/1104] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:57 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:59.119974 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:01:59.120595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:01:59.127886 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:59.128378 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:59.128834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:59.129565 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:59.130017 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:59.130435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:59.272178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:01:59.281560 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3944674a-e7e6-447f-9094-c35ab7bbb496 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.165440 Sep 26 06:01:59.282178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 556/1105] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:01:59 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:01:59.513041 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03274ff5-16a4-468b-a4bc-4a320240179f", "name": "network-vif-unplugged", "status": "completed", "tag": "a2005324-0611-48ff-9c1d-d25f11767b64"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:01:59.529623 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:01:59.530303 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:01:59.530748 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:01:59.543951 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] Creating event network-vif-unplugged:a2005324-0611-48ff-9c1d-d25f11767b64 for instance 03274ff5-16a4-468b-a4bc-4a320240179f on hv-cinder-83608 Sep 26 06:01:59.547552 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR oslo.messaging._drivers.impl_rabbit [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] [5db52d3c-5a40-4f10-9b88-441e3043ad08] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 06:02:00.308051 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:00.308652 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:00.316789 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:00.317306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:00.317751 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:00.318433 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:00.318888 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:00.319310 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:00.458601 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:00.466752 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-076d1bfd-223b-433b-8a9e-d9df31592a18 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.164635 Sep 26 06:02:00.467320 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 557/1106] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:00 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:00.555180 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] [5db52d3c-5a40-4f10-9b88-441e3043ad08] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48120. Sep 26 06:02:00.559743 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-2c67fa4d-f2ea-4ec3-bc3a-34f4c68ea0a8 req-f0e80462-7306-4064-aff1-266082cb9ea6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.050399 Sep 26 06:02:00.560369 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 550/1107] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:02:01.490363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:01.490919 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:01.499091 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:01.499582 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:01.500015 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:01.500741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:01.501208 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:01.501637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:01.656200 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:01.664771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-01fd31ae-a662-4965-8433-0da2b580e136 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.178695 Sep 26 06:02:01.665366 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 558/1108] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:01 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:02.689370 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:02.690033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:02.696598 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:02.697085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:02.697540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:02.698590 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:02.699010 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:02.699456 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:02.860449 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:02.868121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-3c42b516-032d-4068-a1ef-bdce07f883a8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.183619 Sep 26 06:02:02.868710 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 551/1109] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:02 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:03.892528 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:03.893191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:03.900347 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:03.900834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:03.901295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:03.901988 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:03.902435 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:03.902850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:04.043637 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:04.056623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-f0ca0413-110b-40d6-ac43-5d92b3a79494 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.167825 Sep 26 06:02:04.057600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 559/1110] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:03 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:05.085244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:05.085955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:05.093956 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:05.094411 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:05.094849 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:05.095572 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:05.096042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:05.096440 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:05.249326 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:05.257783 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-40109ed4-d4ee-453a-8edf-20cfe145853c tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.177617 Sep 26 06:02:05.258356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 552/1111] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:05 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:06.281717 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:06.282272 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:06.289297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:06.289785 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:06.290207 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:06.290885 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:06.291332 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:06.291741 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:06.310821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:06.441484 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:06.449922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-112ab910-ca2d-4207-8464-6cd3021532e9 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.172167 Sep 26 06:02:06.450496 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 560/1112] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:06 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:07.476218 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:07.476829 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:07.484067 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:07.484557 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:07.484991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:07.485736 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:07.486191 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:07.486613 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:07.641517 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:07.649646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-59bfaa8d-4548-4d10-9b32-d4dc80c6c45d tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1575 microversion: 2.1 time: 0.177399 Sep 26 06:02:07.650225 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 553/1113] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:07 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:08.673713 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:02:08.674401 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:02:08.676929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=31 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:08.682623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:08.683161 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:08.683575 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:08.684273 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:08.684720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:08.685157 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:08.835385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:02:08.844262 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ac6ff528-5dfa-4379-864a-feb78aac0895 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1562 microversion: 2.1 time: 0.174762 Sep 26 06:02:08.844856 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 561/1114] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:02:08 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:02:11.623104 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-2977cd76-6c79-4641-84bb-980eb67ab0bd req-649236b2-ed9c-4b9e-aa6c-b88c4a7ac96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03274ff5-16a4-468b-a4bc-4a320240179f", "name": "network-vif-plugged", "status": "completed", "tag": "a2005324-0611-48ff-9c1d-d25f11767b64"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:02:11.630902 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:11.639977 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2977cd76-6c79-4641-84bb-980eb67ab0bd req-649236b2-ed9c-4b9e-aa6c-b88c4a7ac96e service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:02:11.640785 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2977cd76-6c79-4641-84bb-980eb67ab0bd req-649236b2-ed9c-4b9e-aa6c-b88c4a7ac96e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:02:11.641403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-2977cd76-6c79-4641-84bb-980eb67ab0bd req-649236b2-ed9c-4b9e-aa6c-b88c4a7ac96e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:02:11.647287 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:11.657998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-2977cd76-6c79-4641-84bb-980eb67ab0bd req-649236b2-ed9c-4b9e-aa6c-b88c4a7ac96e service nova] Creating event network-vif-plugged:a2005324-0611-48ff-9c1d-d25f11767b64 for instance 03274ff5-16a4-468b-a4bc-4a320240179f on hv-cinder-83608 Sep 26 06:02:11.663438 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-2977cd76-6c79-4641-84bb-980eb67ab0bd req-649236b2-ed9c-4b9e-aa6c-b88c4a7ac96e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045820 Sep 26 06:02:11.664476 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 554/1115] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 06:03:45.279514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:03:45.280228 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:03:45.282305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:45.282948 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=8 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:45.292403 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:45.293008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:45.293538 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:45.294448 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:45.294858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:45.295728 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:45.323733 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 06:03:45.382157 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-a2c52388-e605-41ed-8e8a-48d90c645e94 req-3d37f9df-b2e4-4e93-b653-0e3000a07061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03274ff5-16a4-468b-a4bc-4a320240179f", "tag": "a2005324-0611-48ff-9c1d-d25f11767b64"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:03:45.394253 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a2c52388-e605-41ed-8e8a-48d90c645e94 req-3d37f9df-b2e4-4e93-b653-0e3000a07061 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:45.394740 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a2c52388-e605-41ed-8e8a-48d90c645e94 req-3d37f9df-b2e4-4e93-b653-0e3000a07061 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:45.395173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-a2c52388-e605-41ed-8e8a-48d90c645e94 req-3d37f9df-b2e4-4e93-b653-0e3000a07061 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:45.409628 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-a2c52388-e605-41ed-8e8a-48d90c645e94 req-3d37f9df-b2e4-4e93-b653-0e3000a07061 service nova] Creating event network-changed:a2005324-0611-48ff-9c1d-d25f11767b64 for instance 03274ff5-16a4-468b-a4bc-4a320240179f on hv-cinder-83608 Sep 26 06:03:45.410043 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-c58c748c-234c-4307-8527-cc8da5a6f536 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "DELETE /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 204 len: 0 microversion: 2.1 time: 0.135204 Sep 26 06:03:45.410883 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 562/1116] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 06:03:45 2022] DELETE /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 06:03:45.416576 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-a2c52388-e605-41ed-8e8a-48d90c645e94 req-3d37f9df-b2e4-4e93-b653-0e3000a07061 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138074 Sep 26 06:03:45.417540 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 555/1117] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:03:45.419829 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:03:45.420487 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:03:45.426771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:45.427255 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:45.427686 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:45.428431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:45.428866 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:45.429317 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:45.564198 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:03:45.572814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1cac5c6b-e5a7-4d3c-b31f-27b3a3f15633 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.157541 Sep 26 06:03:45.573520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 563/1118] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:03:45 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 06:03:46.596677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:03:46.597403 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:03:46.604619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:46.605248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:46.605553 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:46.606244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:46.606689 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:46.607101 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:46.799299 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:03:46.807525 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-9c91fcc9-ed54-4bd6-9662-0df296c958cd tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1568 microversion: 2.1 time: 0.215126 Sep 26 06:03:46.808088 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 556/1119] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:03:46 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:03:47.831783 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:03:47.832505 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:03:47.839583 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:47.840170 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:47.840671 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:47.841603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:47.841861 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:47.842306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:47.912297 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7734565b147c40bebfeea7e093abc393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098526f06e1a43fa9e94e805f72fed14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:03:47.913455 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-c16966bf-fe73-4541-ac31-2343d94ecd6e req-5336221a-5c33-4542-b5ef-5a2e54e9017b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03274ff5-16a4-468b-a4bc-4a320240179f", "name": "network-vif-deleted", "tag": "a2005324-0611-48ff-9c1d-d25f11767b64"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:03:47.921750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1d87509b-6a7d-48aa-97b3-d13ae2837d61 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 200 len: 1381 microversion: 2.1 time: 0.093888 Sep 26 06:03:47.922490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 564/1120] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:03:47 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 1381 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:03:47.923896 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c16966bf-fe73-4541-ac31-2343d94ecd6e req-5336221a-5c33-4542-b5ef-5a2e54e9017b service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:47.924380 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c16966bf-fe73-4541-ac31-2343d94ecd6e req-5336221a-5c33-4542-b5ef-5a2e54e9017b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:47.924806 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-c16966bf-fe73-4541-ac31-2343d94ecd6e req-5336221a-5c33-4542-b5ef-5a2e54e9017b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:47.938996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-c16966bf-fe73-4541-ac31-2343d94ecd6e req-5336221a-5c33-4542-b5ef-5a2e54e9017b service nova] Creating event network-vif-deleted:a2005324-0611-48ff-9c1d-d25f11767b64 for instance 03274ff5-16a4-468b-a4bc-4a320240179f on hv-cinder-83608 Sep 26 06:03:47.944022 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-c16966bf-fe73-4541-ac31-2343d94ecd6e req-5336221a-5c33-4542-b5ef-5a2e54e9017b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034429 Sep 26 06:03:47.944618 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 557/1121] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 06:03:48.949463 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:03:48.950082 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] [instance: 03274ff5-16a4-468b-a4bc-4a320240179f] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:03:48.956825 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:48.957281 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:48.957753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:48.958626 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:03:48.959098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:03:48.959510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:03:48.975230 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] HTTP exception thrown: Instance 03274ff5-16a4-468b-a4bc-4a320240179f could not be found. Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Request method failure captured: Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f HTTP/1.1 Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMT9-bN1-Vi8PuUhl3AmAi5Lyezgb1VYtZVnUJ-rrdOiunAgVLWB_VnlTCRln8IFOEHxLU5sbhBF0dbpyr2yWJLxEFIIXyjM03e_ZpEXzXfTsHcpP3gcjbddgHT5KzzlOJ-Uo8mD7Tsv5jd-OMdSywQJd8_W_bZIBbso_bluQXY6c4L4 Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: 098526f06e1a43fa9e94e805f72fed14 Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-TestShelveInstance-29650804 Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 06:03:48.976896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098526f06e1a43fa9e94e805f72fed14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/098526f06e1a43fa9e94e805f72fed14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/098526f06e1a43fa9e94e805f72fed14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_098526f06e1a43fa9e94e805f72fed14", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-TestShelveInstance-29650804 Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: 098526f06e1a43fa9e94e805f72fed14 Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-TestShelveInstance-29650804 Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-TestShelveInstance-29650804-project Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: 7734565b147c40bebfeea7e093abc393 Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-TestShelveInstance-29650804-project Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 03274ff5-16a4-468b-a4bc-4a320240179f could not be found. Sep 26 06:03:48.978794 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '03274ff5-16a4-468b-a4bc-4a320240179f'} Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03274ff5-16a4-468b-a4bc-4a320240179f could not be found. Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 06:03:48.979969 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03274ff5-16a4-468b-a4bc-4a320240179f could not be found. Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03274ff5-16a4-468b-a4bc-4a320240179f could not be found. Sep 26 06:03:48.981720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:03:48.983306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Returning 404 to user: Instance 03274ff5-16a4-468b-a4bc-4a320240179f could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 06:03:48.983306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0d6adb60-5a80-4198-bb8a-1b11c7b12fd8 tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f" status: 404 len: 111 microversion: 2.1 time: 0.035043 Sep 26 06:03:48.983306 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 565/1122] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:03:48 2022] GET /compute/v2.1/servers/03274ff5-16a4-468b-a4bc-4a320240179f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 06:03:49.170757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-1613e9c2-db11-4410-8fd0-ff26bd5144cf tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] Calling method '.version_select at 0x7f1e5e3ab670>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:03:49.213621 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-1613e9c2-db11-4410-8fd0-ff26bd5144cf tempest-TestShelveInstance-29650804 tempest-TestShelveInstance-29650804-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1182630542" status: 202 len: 0 microversion: 2.1 time: 0.046726 Sep 26 06:03:49.214655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 558/1123] 10.222.0.57 () {58 vars in 1254 bytes} [Mon Sep 26 06:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1182630542 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 06:04:06.756802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:06.757862 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:06.948871 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-4d8f0e99-ec0c-4b13-84f6-6d43ad0feb62 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Action: 'create', calling method: .version_select at 0x7f1e5e43cc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-176529439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcMpC+6ExNv+fuWBCaWuPH+D+NTijrdFJCYYOFFLNNtQoeolvxoriwtQaZKZ6ltd3MdNquXP8TVqSJNR0xfVlgm0goq/35T9lCLA0qre511aSVJbbPHbvGXEZseE3nktw=="}} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:04:06.966188 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-4d8f0e99-ec0c-4b13-84f6-6d43ad0feb62 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for project fe22d212c0eb4df3800b0e80d722e217. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 06:04:06.970900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.quota [None req-4d8f0e99-ec0c-4b13-84f6-6d43ad0feb62 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for user ff51bc306c6444ac99ac4c93ea63ac7f and project fe22d212c0eb4df3800b0e80d722e217. Resources: {'key_pairs'} {{(pid=127274) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 06:04:07.001791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-4d8f0e99-ec0c-4b13-84f6-6d43ad0feb62 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.251890 Sep 26 06:04:07.003747 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 566/1124] 10.222.0.57 () {60 vars in 1159 bytes} [Mon Sep 26 06:04:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:04:28.925030 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=11 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:28.925805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:28.930152 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-103513688", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-176529439", "security_groups": [{"name": "tempest-secgroup-smoke-1969979083"}], "block_device_mapping_v2": [{"uuid": "bf2a2c5b-aaf5-477b-8220-f52a49b84da3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41837bd9-fbbb-4100-bda5-5dd8c6633ace"}]}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:04:29.177248 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] validate_networks() for [('41837bd9-fbbb-4100-bda5-5dd8c6633ace', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 06:04:29.674986 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 06:04:29.675414 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 06:04:29.675893 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 06:04:29.676306 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 06:04:29.676714 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 06:04:29.686680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:29.687174 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:29.687612 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:29.688320 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:29.688777 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:29.689212 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:29.709378 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for project fe22d212c0eb4df3800b0e80d722e217. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 06:04:29.713574 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for user ff51bc306c6444ac99ac4c93ea63ac7f and project fe22d212c0eb4df3800b0e80d722e217. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 06:04:29.772202 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 06:04:29.774501 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf2a2c5b-aaf5-477b-8220-f52a49b84da3',volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 06:04:29.913350 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-41338b05-e245-4416-917b-3c40df9674bd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.989802 Sep 26 06:04:29.913996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 559/1125] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 06:04:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 06:04:29.922823 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=4 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:29.923595 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:29.927423 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-65991dad-8d6a-439c-93b0-6087c25e5d31 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:29.928136 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-65991dad-8d6a-439c-93b0-6087c25e5d31 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:30.042390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-65991dad-8d6a-439c-93b0-6087c25e5d31 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:30.050307 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-65991dad-8d6a-439c-93b0-6087c25e5d31 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1093 microversion: 2.1 time: 0.128776 Sep 26 06:04:30.050966 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 567/1126] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:29 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1093 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:31.074295 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:31.074890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:31.086145 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:31.086717 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:31.087191 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:31.088433 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:31.089051 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:31.089496 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:31.153487 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:31.161680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-db7beb94-97ab-43c4-9f96-645409ea4eba tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1191 microversion: 2.1 time: 0.092206 Sep 26 06:04:31.162245 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 560/1127] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:31 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:32.185921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:32.186640 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:32.194479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:32.195226 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:32.195997 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:32.197285 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:32.198697 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:32.198858 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:32.340671 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:32.349715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1c36b4db-3b88-40cd-84bf-7b7f40733e4c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.167835 Sep 26 06:04:32.350290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 568/1128] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:32 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:32.861792 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-6e86e587-5b7e-4936-b9e4-a80387b4cf6f req-de93e08b-8667-4d99-a89d-c05df7df8329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4569e22c-f206-456d-b9c1-a141f9f1b073", "tag": "03bb1c03-255f-4922-98a2-f6aa06ceadaa"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:04:32.872724 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6e86e587-5b7e-4936-b9e4-a80387b4cf6f req-de93e08b-8667-4d99-a89d-c05df7df8329 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:32.873329 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6e86e587-5b7e-4936-b9e4-a80387b4cf6f req-de93e08b-8667-4d99-a89d-c05df7df8329 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:32.873757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6e86e587-5b7e-4936-b9e4-a80387b4cf6f req-de93e08b-8667-4d99-a89d-c05df7df8329 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:32.885863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-6e86e587-5b7e-4936-b9e4-a80387b4cf6f req-de93e08b-8667-4d99-a89d-c05df7df8329 service nova] Creating event network-changed:03bb1c03-255f-4922-98a2-f6aa06ceadaa for instance 4569e22c-f206-456d-b9c1-a141f9f1b073 on hv-cinder-83608 Sep 26 06:04:32.891085 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-6e86e587-5b7e-4936-b9e4-a80387b4cf6f req-de93e08b-8667-4d99-a89d-c05df7df8329 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033558 Sep 26 06:04:32.891693 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 561/1129] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:04:33.373566 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:33.374195 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:33.381070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:33.381600 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:33.382040 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:33.382743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:33.383315 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:33.383780 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:33.518571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:33.526495 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a96636bd-c970-45b1-a9d1-c1ce791dd825 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.157117 Sep 26 06:04:33.527071 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 569/1130] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:33 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:34.553246 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:34.553996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:34.560494 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:34.560983 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:34.561448 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:34.562146 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:34.562619 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:34.563018 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:34.954265 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:34.965399 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a71983b2-6951-477e-8677-ff4a8d9de8e1 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.416612 Sep 26 06:04:34.966171 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 562/1131] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:34 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:35.988576 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:35.989216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:35.996068 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:35.996574 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:35.997024 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:35.997777 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:35.998246 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:35.998678 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:36.138894 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:36.147236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-3f020bda-0996-4340-9812-a079e914a2e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.162817 Sep 26 06:04:36.147793 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 570/1132] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:35 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:37.170832 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:37.171406 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:37.178993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:37.179478 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:37.179912 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:37.180607 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:37.181060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:37.181518 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:37.327021 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:37.339390 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c0768962-3115-4e7d-b19a-3274e8f266b2 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.172346 Sep 26 06:04:37.340111 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 563/1133] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:37 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:38.367655 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:38.368358 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:38.377074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:38.377724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:38.378266 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:38.379132 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:38.379700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:38.380227 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:38.515213 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:38.523591 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-0776ee06-3e68-4c30-8294-ad34d83ff30c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.161031 Sep 26 06:04:38.524174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 571/1134] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:38 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:39.546127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:39.546887 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:39.554761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:39.555242 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:39.555691 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:39.556400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:39.556855 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:39.557318 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:39.697922 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:39.703696 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:39.716881 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f752158d-7b28-4389-b0e9-8c194fcd7e10 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.174791 Sep 26 06:04:39.717853 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 564/1135] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:39 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:40.744653 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:40.745432 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:40.747839 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:40.754535 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:40.755131 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:40.755668 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:40.756545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:40.757058 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:40.757602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:40.906835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:40.915236 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-e1f2892d-aff9-4189-bed4-ef0923a3a167 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.175399 Sep 26 06:04:40.915782 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 572/1136] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:40 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:41.941237 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:41.941888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:41.943941 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=6 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:04:41.950161 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:41.950662 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:41.951101 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:41.951810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:41.952268 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:41.952692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:42.104960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:42.112926 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-75c14a5d-edc3-4a6a-ad47-eaf84637d4bb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.177891 Sep 26 06:04:42.113562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 565/1137] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:41 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:43.136083 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:43.136726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:43.144231 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:43.144718 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:43.145179 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:43.145887 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:43.146340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:43.146771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:43.286133 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:43.294654 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-339d3ed9-1500-4741-8b67-6b5d343d8cb7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.162528 Sep 26 06:04:43.295240 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 573/1138] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:43 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:44.317872 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:44.318509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:44.325575 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:44.326082 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:44.326544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:44.327305 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:44.327680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:44.328093 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:44.429571 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-9095fff9-133a-4afd-b51f-125d058d2471 req-69a292d5-6e43-465d-b7aa-73ddce644b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4569e22c-f206-456d-b9c1-a141f9f1b073", "name": "network-vif-plugged", "status": "completed", "tag": "03bb1c03-255f-4922-98a2-f6aa06ceadaa"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:04:44.439602 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-9095fff9-133a-4afd-b51f-125d058d2471 req-69a292d5-6e43-465d-b7aa-73ddce644b1c service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:44.440074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-9095fff9-133a-4afd-b51f-125d058d2471 req-69a292d5-6e43-465d-b7aa-73ddce644b1c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:44.440730 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-9095fff9-133a-4afd-b51f-125d058d2471 req-69a292d5-6e43-465d-b7aa-73ddce644b1c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:44.452844 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-9095fff9-133a-4afd-b51f-125d058d2471 req-69a292d5-6e43-465d-b7aa-73ddce644b1c service nova] Creating event network-vif-plugged:03bb1c03-255f-4922-98a2-f6aa06ceadaa for instance 4569e22c-f206-456d-b9c1-a141f9f1b073 on hv-cinder-83608 Sep 26 06:04:44.457982 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-9095fff9-133a-4afd-b51f-125d058d2471 req-69a292d5-6e43-465d-b7aa-73ddce644b1c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093622 Sep 26 06:04:44.458579 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 574/1139] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 06:04:44.477562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:44.489192 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f0e811bc-ebaf-4861-a97d-4b2c6804a911 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.174956 Sep 26 06:04:44.489772 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 566/1140] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:44 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:45.515764 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:45.516701 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:45.525798 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:45.526479 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:45.527108 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:45.528074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:45.528716 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:45.529353 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:45.676151 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:45.687434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-45e5aec0-287a-4114-8ed1-315cf75874f6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1265 microversion: 2.1 time: 0.178275 Sep 26 06:04:45.688133 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 575/1141] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:45 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:46.713003 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:46.713639 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:46.720601 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:46.721086 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:46.721545 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:46.722341 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:46.722787 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:46.723206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:46.866534 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:46.874458 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-750a3927-f496-47de-b178-6a5ef0ec85fc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1451 microversion: 2.1 time: 0.165533 Sep 26 06:04:46.875033 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 567/1142] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:46 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:46.896899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:04:46.897567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:04:46.904762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:46.905267 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:46.905705 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:46.906409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:46.906847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:46.907268 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:47.050792 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:04:47.062814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-fb44588f-9846-431b-8736-879eb896f3aa tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1451 microversion: 2.1 time: 0.169716 Sep 26 06:04:47.063525 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 576/1143] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:04:46 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:04:49.102809 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-dd2d3a59-6f76-463a-b7d3-6ac0759bee42 req-08445fff-4a38-4b4d-a1cb-6bc444cb9f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4569e22c-f206-456d-b9c1-a141f9f1b073", "tag": "03bb1c03-255f-4922-98a2-f6aa06ceadaa"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:04:49.112638 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-dd2d3a59-6f76-463a-b7d3-6ac0759bee42 req-08445fff-4a38-4b4d-a1cb-6bc444cb9f7b service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:04:49.113109 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-dd2d3a59-6f76-463a-b7d3-6ac0759bee42 req-08445fff-4a38-4b4d-a1cb-6bc444cb9f7b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:04:49.113580 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-dd2d3a59-6f76-463a-b7d3-6ac0759bee42 req-08445fff-4a38-4b4d-a1cb-6bc444cb9f7b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:04:49.125099 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-dd2d3a59-6f76-463a-b7d3-6ac0759bee42 req-08445fff-4a38-4b4d-a1cb-6bc444cb9f7b service nova] Creating event network-changed:03bb1c03-255f-4922-98a2-f6aa06ceadaa for instance 4569e22c-f206-456d-b9c1-a141f9f1b073 on hv-cinder-83608 Sep 26 06:04:49.130334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-dd2d3a59-6f76-463a-b7d3-6ac0759bee42 req-08445fff-4a38-4b4d-a1cb-6bc444cb9f7b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089797 Sep 26 06:04:49.130938 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 568/1144] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:07:02.998941 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] AMQP server on 10.222.0.57:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 26 06:07:02.999756 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=22 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:07:03.000649 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=50 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:07:03.001950 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:07:03.002178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 06:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 (ip 10.222.0.57) !!! Sep 26 06:07:03.004868 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 06:07:03.005114 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 06:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 (ip 10.222.0.57) !!! Sep 26 06:07:03.007286 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:07:03.007439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 06:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 (ip 10.222.0.57) !!! Sep 26 06:07:03.016851 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:03.017367 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:03.026707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:03.027185 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:03.027623 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:03.028305 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:03.028753 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:03.029191 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:03.056224 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Going to try to terminate instance {{(pid=127274) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 06:07:03.136009 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1db0b85c-7896-4243-98e5-22b3d179c26d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 204 len: 0 microversion: 2.1 time: 0.139952 Sep 26 06:07:03.136599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 577/1145] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 06:07:02 2022] DELETE /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 06:07:03.144879 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b9c2cd27-7bfb-4103-aa4c-09fff6db273b] AMQP server on 10.222.0.57:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 26 06:07:03.145502 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:07:03.146563 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=48 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:07:03.147474 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:07:03.147684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 06:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 (ip 10.222.0.57) !!! Sep 26 06:07:03.149053 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:07:03.149224 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 06:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 (ip 10.222.0.57) !!! Sep 26 06:07:03.150236 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 06:07:03.150353 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 06:07:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 (ip 10.222.0.57) !!! Sep 26 06:07:03.162801 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:03.163504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:03.175415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:03.175899 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:03.176334 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:03.177034 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:03.177525 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:03.177980 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:03.313419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:03.321921 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a1b6eeb6-7c2c-489f-bd99-da42501352b7 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1576 microversion: 2.1 time: 0.180072 Sep 26 06:07:03.322493 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 569/1146] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:03 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 06:07:04.351434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:04.353219 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:04.368795 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48570. Sep 26 06:07:04.371312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:04.371791 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:04.372220 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:04.372931 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:04.373390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:04.373809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:04.512119 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:04.520311 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-7574d3c1-4960-4228-8e4c-91e47d7af6d6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1576 microversion: 2.1 time: 0.176382 Sep 26 06:07:04.520891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 578/1147] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:04 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:05.545362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:05.546020 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:05.559408 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] [b9c2cd27-7bfb-4103-aa4c-09fff6db273b] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48576. Sep 26 06:07:05.561883 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:05.562487 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:05.562919 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:05.563630 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:05.564091 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:05.564506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:05.640890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:05.649127 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-4119b7c2-a6ce-478d-8747-e875e66bf803 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1508 microversion: 2.1 time: 0.107782 Sep 26 06:07:05.649739 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 570/1148] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:05 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1508 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:05.825099 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-03ae0bd7-9454-4171-9348-fc20edc21b95 req-9c613418-0618-4750-b990-5f29da9053ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4569e22c-f206-456d-b9c1-a141f9f1b073", "name": "network-vif-deleted", "tag": "03bb1c03-255f-4922-98a2-f6aa06ceadaa"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:07:05.835603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-03ae0bd7-9454-4171-9348-fc20edc21b95 req-9c613418-0618-4750-b990-5f29da9053ab service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:05.836128 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-03ae0bd7-9454-4171-9348-fc20edc21b95 req-9c613418-0618-4750-b990-5f29da9053ab service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:05.836541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-03ae0bd7-9454-4171-9348-fc20edc21b95 req-9c613418-0618-4750-b990-5f29da9053ab service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:05.853540 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-03ae0bd7-9454-4171-9348-fc20edc21b95 req-9c613418-0618-4750-b990-5f29da9053ab service nova] Creating event network-vif-deleted:03bb1c03-255f-4922-98a2-f6aa06ceadaa for instance 4569e22c-f206-456d-b9c1-a141f9f1b073 on hv-cinder-83608 Sep 26 06:07:05.859534 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-03ae0bd7-9454-4171-9348-fc20edc21b95 req-9c613418-0618-4750-b990-5f29da9053ab service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038543 Sep 26 06:07:05.860514 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 579/1149] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:07:06.673594 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:06.674767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:06.681526 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:06.682049 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:06.682483 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:06.683240 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:06.683694 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:06.684121 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:06.717994 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:06.718345 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:06.718780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:06.719375 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.objects.instance [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lazy-loading 'fault' on Instance uuid 4569e22c-f206-456d-b9c1-a141f9f1b073 {{(pid=127275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 06:07:06.769546 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:06.779995 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-12814f9a-7634-4b6e-9bc2-1544edadca8c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 200 len: 1183 microversion: 2.1 time: 0.110311 Sep 26 06:07:06.780738 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 571/1150] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:06 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 1183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:07.806847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:07.807486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:07.814677 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:07.815155 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:07.815582 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:07.816260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:07.816687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:07.817115 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:07.831189 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] HTTP exception thrown: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Request method failure captured: Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 HTTP/1.1 Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMUDRwhE9I0sae01H-wL-hZujCBtRl56FMOZO5XxDhbPvseNFzNS_1oGyQ2DF-dKPO57bIgmrlxPByIU0l_DmnUBE-felAJAgdVfsCGVbIbhiIAg1tt2NC4x8lulHYBGNGYKSJWfSMTuT9Otaf37ZyZOvFBeJQTWuARxAjCSqgKZNGvY Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 06:07:07.832814 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fe22d212c0eb4df3800b0e80d722e217", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-TestVolumeBootPattern-882261853 Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: ff51bc306c6444ac99ac4c93ea63ac7f Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:07:07.834694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '4569e22c-f206-456d-b9c1-a141f9f1b073'} Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 06:07:07.835802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:07:07.837545 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:07:07.839098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Returning 404 to user: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 06:07:07.839098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-63da07b3-e2ce-45a0-b2b8-c10c6670ce8e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 404 len: 111 microversion: 2.1 time: 0.032173 Sep 26 06:07:07.839098 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 580/1151] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:07 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 06:07:07.887437 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1933205384", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-176529439", "security_groups": [{"name": "tempest-secgroup-smoke-1969979083"}], "block_device_mapping_v2": [{"uuid": "bf2a2c5b-aaf5-477b-8220-f52a49b84da3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41837bd9-fbbb-4100-bda5-5dd8c6633ace"}]}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:07:08.025945 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] validate_networks() for [('41837bd9-fbbb-4100-bda5-5dd8c6633ace', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 06:07:08.409097 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 06:07:08.409547 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 06:07:08.410046 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 06:07:08.410452 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 06:07:08.410861 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 06:07:08.420060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:08.420648 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:08.421089 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:08.421823 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:08.422307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:08.422848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:08.439771 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for project fe22d212c0eb4df3800b0e80d722e217. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 06:07:08.444131 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for user ff51bc306c6444ac99ac4c93ea63ac7f and project fe22d212c0eb4df3800b0e80d722e217. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 06:07:08.506239 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 06:07:08.508371 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf2a2c5b-aaf5-477b-8220-f52a49b84da3',volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 06:07:08.665732 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-b344120f-0659-4219-b2ad-873d22f1763e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784474 Sep 26 06:07:08.666260 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 572/1152] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 06:07:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 06:07:08.677987 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-1e429c81-256e-493a-907e-509e9b82e2f3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:08.678598 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-1e429c81-256e-493a-907e-509e9b82e2f3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:08.734698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-1e429c81-256e-493a-907e-509e9b82e2f3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:08.741954 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-1e429c81-256e-493a-907e-509e9b82e2f3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1094 microversion: 2.1 time: 0.067988 Sep 26 06:07:08.742523 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 581/1153] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:08 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:09.764770 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:09.765506 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:09.772190 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:09.772674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:09.773102 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:09.773827 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:09.774277 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:09.774694 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:09.839234 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:09.847216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8fc4fbf8-b63d-408e-ba63-b8b8c037445d tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1192 microversion: 2.1 time: 0.086879 Sep 26 06:07:09.847798 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 573/1154] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:09 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:10.871301 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:10.871900 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:10.880034 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:10.880515 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:10.880939 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:10.881668 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:10.882117 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:10.882523 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:11.020360 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:11.029388 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-234d08c4-c968-4e01-987c-bc1fd99bbe63 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.161932 Sep 26 06:07:11.029982 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 582/1155] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:10 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:11.350173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-6d4f2f7d-2930-4296-ab0c-8bbb806410e3 req-1f45585b-c6ca-4e06-b42c-febcf63544c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba6f9bf-29a7-4164-a989-efe1687e25e5", "tag": "7a9c18ef-ab34-42cb-9f25-1dd370c4d939"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:07:11.362359 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6d4f2f7d-2930-4296-ab0c-8bbb806410e3 req-1f45585b-c6ca-4e06-b42c-febcf63544c3 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:11.363960 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6d4f2f7d-2930-4296-ab0c-8bbb806410e3 req-1f45585b-c6ca-4e06-b42c-febcf63544c3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:11.364420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-6d4f2f7d-2930-4296-ab0c-8bbb806410e3 req-1f45585b-c6ca-4e06-b42c-febcf63544c3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:11.377173 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-6d4f2f7d-2930-4296-ab0c-8bbb806410e3 req-1f45585b-c6ca-4e06-b42c-febcf63544c3 service nova] Creating event network-changed:7a9c18ef-ab34-42cb-9f25-1dd370c4d939 for instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 on hv-cinder-83608 Sep 26 06:07:11.384072 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-6d4f2f7d-2930-4296-ab0c-8bbb806410e3 req-1f45585b-c6ca-4e06-b42c-febcf63544c3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039068 Sep 26 06:07:11.384822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 574/1156] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:07:12.054539 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:12.055159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:12.062390 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:12.062899 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:12.063359 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:12.064336 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:12.064532 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:12.065124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:12.198045 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:12.206261 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-45cc6913-113b-4565-953b-dcabad6aa675 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.156014 Sep 26 06:07:12.206834 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 583/1157] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:12 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:13.229811 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:13.230761 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:13.238491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:13.239244 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:13.239665 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:13.240392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:13.240848 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:13.241307 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:13.431343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:13.439469 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-c71732be-08dc-4f7f-971f-ed186f31e0bc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.213949 Sep 26 06:07:13.440027 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 575/1158] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:13 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:14.464323 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:14.465067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:14.473182 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:14.473660 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:14.474087 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:14.474767 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:14.475214 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:14.475628 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:14.634410 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:14.645274 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a1aa36aa-8fe3-4c04-8ddc-66411454fa9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.185755 Sep 26 06:07:14.646231 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 584/1159] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:14 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:15.677288 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:15.677891 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:15.685491 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:15.686172 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:15.686719 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:15.687721 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:15.688351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:15.688931 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:15.841974 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:15.851136 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-279beaf7-29aa-4c31-a4d0-dce9acb59533 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.178076 Sep 26 06:07:15.851692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 576/1160] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:15 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:16.876620 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:16.877379 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:16.883932 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:16.884409 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:16.884842 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:16.885570 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:16.886025 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:16.886444 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:17.025763 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:17.037968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-803aa7e7-e929-4bdf-89aa-43f349c45efe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.166955 Sep 26 06:07:17.038748 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 585/1161] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:16 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:18.061335 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:18.061947 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:18.069001 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:18.069890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:18.070328 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:18.071029 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:18.071487 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:18.071913 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:18.209181 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:18.217562 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-7d942c62-ba6f-4776-9b81-125bb19c7da0 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.160149 Sep 26 06:07:18.218388 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 577/1162] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:18 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:19.241160 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:19.241774 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:19.244299 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:07:19.250126 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:19.250618 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:19.251025 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:19.251755 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:19.252221 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:19.252642 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:19.403933 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:19.412483 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-63a15279-5102-4235-b806-742d68982383 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.175399 Sep 26 06:07:19.413384 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 586/1163] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:19 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:20.438194 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:20.438957 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:20.441363 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:07:20.442039 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=6 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:07:20.448844 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:20.449368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:20.449795 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:20.450515 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:20.450970 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:20.451392 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:20.607757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:20.617155 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ea1efa16-9437-4915-ba26-cbb1bb33cabe tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.183471 Sep 26 06:07:20.617812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 578/1164] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:20 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:21.648351 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:21.649174 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:21.657280 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:21.657859 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:21.658400 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:21.659110 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:21.659743 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:21.660312 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:21.801593 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:21.809468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-ba344e4d-7cdc-4cd1-bb8e-966ffe4bb097 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.165725 Sep 26 06:07:21.810056 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 587/1165] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:21 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:22.832953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:22.833609 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:22.840520 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:22.841006 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:22.841467 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:22.842160 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:22.842611 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:22.843032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:22.987631 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:22.999868 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-25bcbbd5-9ea7-4b76-85e8-8d4b8c3133dd tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.170535 Sep 26 06:07:23.000669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 579/1166] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:22 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:23.255458 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-aed32ad8-faf8-456b-b857-7b1b9b6ef8f3 req-9c2abd5c-636c-45bb-824f-6c7f5d49397b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba6f9bf-29a7-4164-a989-efe1687e25e5", "name": "network-vif-plugged", "status": "completed", "tag": "7a9c18ef-ab34-42cb-9f25-1dd370c4d939"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:07:23.269830 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-aed32ad8-faf8-456b-b857-7b1b9b6ef8f3 req-9c2abd5c-636c-45bb-824f-6c7f5d49397b service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:23.269830 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-aed32ad8-faf8-456b-b857-7b1b9b6ef8f3 req-9c2abd5c-636c-45bb-824f-6c7f5d49397b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:23.269830 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-aed32ad8-faf8-456b-b857-7b1b9b6ef8f3 req-9c2abd5c-636c-45bb-824f-6c7f5d49397b service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:23.280364 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-aed32ad8-faf8-456b-b857-7b1b9b6ef8f3 req-9c2abd5c-636c-45bb-824f-6c7f5d49397b service nova] Creating event network-vif-plugged:7a9c18ef-ab34-42cb-9f25-1dd370c4d939 for instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 on hv-cinder-83608 Sep 26 06:07:23.285486 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-aed32ad8-faf8-456b-b857-7b1b9b6ef8f3 req-9c2abd5c-636c-45bb-824f-6c7f5d49397b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033845 Sep 26 06:07:23.286248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 588/1167] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:07:24.023632 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:24.024281 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:24.031296 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:24.031781 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:24.032216 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:24.032906 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:24.033397 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:24.033812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:24.191205 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:24.199879 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-335c1d5b-54fb-4202-a34e-a0026d81db1f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1266 microversion: 2.1 time: 0.180237 Sep 26 06:07:24.200519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 580/1168] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:24 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:25.224575 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:25.225362 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:25.232216 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:25.232771 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:25.233282 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:25.234046 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:25.234564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:25.234967 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:25.375648 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:25.383921 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-40985c6c-9df4-496c-b8d4-6429542ee9e6 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1453 microversion: 2.1 time: 0.164481 Sep 26 06:07:25.384504 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 589/1169] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:25 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:25.409482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:07:25.410023 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:07:25.416849 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:25.417397 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:25.417814 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:25.418502 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:25.418953 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:25.419385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:25.575999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:07:25.588263 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-32dceb15-3997-4091-94f7-3be3e68ddfda tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1453 microversion: 2.1 time: 0.182476 Sep 26 06:07:25.589042 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 581/1170] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:07:25 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:07:27.266510 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-4f24f2bb-5891-485a-80e2-19cc79c1ee0c req-ebbdaceb-49d7-4fa7-bcdf-adab225cf78c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba6f9bf-29a7-4164-a989-efe1687e25e5", "tag": "7a9c18ef-ab34-42cb-9f25-1dd370c4d939"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:07:27.276975 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-4f24f2bb-5891-485a-80e2-19cc79c1ee0c req-ebbdaceb-49d7-4fa7-bcdf-adab225cf78c service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:07:27.277500 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-4f24f2bb-5891-485a-80e2-19cc79c1ee0c req-ebbdaceb-49d7-4fa7-bcdf-adab225cf78c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:07:27.277909 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-4f24f2bb-5891-485a-80e2-19cc79c1ee0c req-ebbdaceb-49d7-4fa7-bcdf-adab225cf78c service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:07:27.289894 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-4f24f2bb-5891-485a-80e2-19cc79c1ee0c req-ebbdaceb-49d7-4fa7-bcdf-adab225cf78c service nova] Creating event network-changed:7a9c18ef-ab34-42cb-9f25-1dd370c4d939 for instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 on hv-cinder-83608 Sep 26 06:07:27.295074 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-4f24f2bb-5891-485a-80e2-19cc79c1ee0c req-ebbdaceb-49d7-4fa7-bcdf-adab225cf78c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032337 Sep 26 06:07:27.295750 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 590/1171] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:09:37.528457 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:09:37.529294 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=72 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:09:37.535235 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1286228058", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-176529439", "security_groups": [{"name": "tempest-secgroup-smoke-1969979083"}], "block_device_mapping_v2": [{"uuid": "fd4e0750-6181-4ba1-b734-37daf1fc9166", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "41837bd9-fbbb-4100-bda5-5dd8c6633ace"}]}} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:09:37.701677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.network.neutron [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] validate_networks() for [('41837bd9-fbbb-4100-bda5-5dd8c6633ace', None, None, None, None, None)] {{(pid=127275) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 06:09:38.148200 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Flavor limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 06:09:38.148767 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Image limits 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 06:09:38.149406 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Flavor pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 06:09:38.149990 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Image pref 0:0:0 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 06:09:38.150544 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.virt.hardware [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 06:09:38.164189 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:38.164890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:38.165599 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:38.166712 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:38.167350 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:38.167898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:38.186937 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for project fe22d212c0eb4df3800b0e80d722e217. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 06:09:38.191430 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.quota [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Getting quotas for user ff51bc306c6444ac99ac4c93ea63ac7f and project fe22d212c0eb4df3800b0e80d722e217. Resources: {'cores', 'ram', 'instances'} {{(pid=127275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 06:09:38.256301 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Going to run 1 instances... {{(pid=127275) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 06:09:38.258609 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd4e0750-6181-4ba1-b734-37daf1fc9166',volume_size=None,volume_type=None)] {{(pid=127275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 06:09:38.400802 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-40a5c239-4c51-4722-977e-60a43845d724 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.873969 Sep 26 06:09:38.401400 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 582/1172] 10.222.0.57 () {60 vars in 1147 bytes} [Mon Sep 26 06:09:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 06:09:38.410922 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] AMQP server on 10.222.0.57:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 26 06:09:38.412130 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:09:38.412891 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:09:38.418707 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-6fc275ad-95b6-46f4-b6f8-19c04eb15611 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:38.419411 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-6fc275ad-95b6-46f4-b6f8-19c04eb15611 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:38.534374 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-6fc275ad-95b6-46f4-b6f8-19c04eb15611 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:38.541818 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-6fc275ad-95b6-46f4-b6f8-19c04eb15611 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1094 microversion: 2.1 time: 0.132455 Sep 26 06:09:38.542003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 591/1173] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:38 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1094 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:39.566385 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:39.567035 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:39.574567 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:39.575186 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:39.575831 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:39.576807 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:39.577166 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:39.577757 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:39.659183 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:39.667672 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-de15d526-9aef-4da4-be33-04fcf41c7d73 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1210 microversion: 2.1 time: 0.106029 Sep 26 06:09:39.668275 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 583/1174] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:39 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:40.691542 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:40.692154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:40.702175 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:40.702697 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:40.703132 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:40.703855 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:40.704385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:40.704824 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:40.710712 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48782. Sep 26 06:09:40.844319 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:40.852847 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-38c2cc78-9bb5-4808-bcb7-0a8d2b1a56fb tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.165306 Sep 26 06:09:40.853499 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 592/1175] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:40 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:41.072309 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-d2b9227e-6dec-4738-90a1-585709a1b7a5 req-56fb9b12-4fa3-4538-8440-30f756b899d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19203c-c625-4707-bcbe-6f2d4f1bb4a8", "tag": "c79b31ed-a06b-46fe-b0c8-31d92ae98c84"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:09:41.082179 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-d2b9227e-6dec-4738-90a1-585709a1b7a5 req-56fb9b12-4fa3-4538-8440-30f756b899d3 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:41.082637 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-d2b9227e-6dec-4738-90a1-585709a1b7a5 req-56fb9b12-4fa3-4538-8440-30f756b899d3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:41.083062 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-d2b9227e-6dec-4738-90a1-585709a1b7a5 req-56fb9b12-4fa3-4538-8440-30f756b899d3 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:41.094362 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-d2b9227e-6dec-4738-90a1-585709a1b7a5 req-56fb9b12-4fa3-4538-8440-30f756b899d3 service nova] Creating event network-changed:c79b31ed-a06b-46fe-b0c8-31d92ae98c84 for instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 on hv-cinder-83608 Sep 26 06:09:41.099220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-d2b9227e-6dec-4738-90a1-585709a1b7a5 req-56fb9b12-4fa3-4538-8440-30f756b899d3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097788 Sep 26 06:09:41.099894 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 584/1176] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:09:41.877021 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:41.877683 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:41.885164 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:41.885650 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:41.886070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:41.886757 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:41.887194 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:41.887607 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:42.024687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:42.036092 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-06e32453-b525-4c1f-a3c4-a2e5d5f59ca5 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.162761 Sep 26 06:09:42.036867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 593/1177] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:41 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:43.064419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:43.065094 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:43.072420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:43.072916 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:43.073404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:43.074112 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:43.074578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:43.075029 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:43.249999 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:43.258229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-01c4740f-99be-452a-8a80-1f8b7c87c64c tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.199105 Sep 26 06:09:43.258850 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 585/1178] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:43 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:44.285425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:44.286300 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:44.296374 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:44.297028 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:44.297664 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:44.298541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:44.298985 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:44.299408 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:44.439715 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:44.447968 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-5ce319f0-4e61-4452-9cc2-d4dea8fa4c28 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.168708 Sep 26 06:09:44.448511 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 594/1179] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:44 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:45.471217 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:45.471780 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:45.478863 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:45.479356 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:45.479809 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:45.480500 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:45.480957 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:45.481415 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:45.630697 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:45.643482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-a3ca5c4b-ed79-47ae-8087-d303a7b1bd12 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.176397 Sep 26 06:09:45.644060 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 586/1180] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:45 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:46.667118 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:46.667722 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:46.674679 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:46.675165 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:46.675589 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:46.676271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:46.676720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:46.677159 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:46.817029 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:46.830009 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-14a2d078-6ba3-4d7a-8a0f-5e647dc1d33f tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.166520 Sep 26 06:09:46.830736 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 595/1181] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:46 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:47.856477 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:47.857220 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:47.865324 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:47.865810 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:47.866247 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:47.866924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:47.867394 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:47.867843 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:48.017590 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:48.025943 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-f39ed387-9db6-495b-8965-dd3f405e0114 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.174457 Sep 26 06:09:48.026543 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 587/1182] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:47 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:49.058392 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:49.059018 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:49.061431 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell0:SELECT=2 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:09:49.067210 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:49.067698 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:49.068490 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:49.069202 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:49.069651 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:49.070070 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:49.207726 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:49.216003 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-9d16699a-f183-46e2-aa6f-e6e4f69388b9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.161606 Sep 26 06:09:49.216564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 596/1183] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:49 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:50.239939 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:50.240521 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:50.242674 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=2 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:09:50.243351 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell0:SELECT=6 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:09:50.250420 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:50.250910 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:50.251346 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:50.252049 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:50.252482 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:50.253032 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:50.391993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:50.403934 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-050e11aa-a9bc-4860-a0fc-dad3de9a301a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.167898 Sep 26 06:09:50.404777 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 588/1184] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:50 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:51.427820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:51.428385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:51.435199 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:51.435687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:51.436120 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:51.436809 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:51.437290 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:51.437700 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:51.580938 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:51.588835 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-71145a38-03f6-4669-b4c4-23354b881170 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.165127 Sep 26 06:09:51.589437 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 597/1185] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:51 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:52.004125 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [req-cd54674c-21a2-44f1-8ba3-a25223cb36d4 req-46201562-46a9-4576-be65-5cae37a2a90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e19203c-c625-4707-bcbe-6f2d4f1bb4a8", "name": "network-vif-plugged", "status": "completed", "tag": "c79b31ed-a06b-46fe-b0c8-31d92ae98c84"}]} {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:09:52.013948 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-cd54674c-21a2-44f1-8ba3-a25223cb36d4 req-46201562-46a9-4576-be65-5cae37a2a90f service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:52.014516 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-cd54674c-21a2-44f1-8ba3-a25223cb36d4 req-46201562-46a9-4576-be65-5cae37a2a90f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:52.014967 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [req-cd54674c-21a2-44f1-8ba3-a25223cb36d4 req-46201562-46a9-4576-be65-5cae37a2a90f service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:52.027523 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.compute.server_external_events [req-cd54674c-21a2-44f1-8ba3-a25223cb36d4 req-46201562-46a9-4576-be65-5cae37a2a90f service nova] Creating event network-vif-plugged:c79b31ed-a06b-46fe-b0c8-31d92ae98c84 for instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 on hv-cinder-83608 Sep 26 06:09:52.032998 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [req-cd54674c-21a2-44f1-8ba3-a25223cb36d4 req-46201562-46a9-4576-be65-5cae37a2a90f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081852 Sep 26 06:09:52.033633 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 589/1186] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:09:52.615063 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:52.615694 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:52.625324 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:52.626008 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:52.626573 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:52.627647 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:52.628109 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:52.628529 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:52.774929 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:52.785683 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-45ea5b8d-1064-4694-bbe2-418d9f912380 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.177006 Sep 26 06:09:52.786259 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 598/1187] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:52 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:53.813271 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:53.814206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:53.823586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:53.824256 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:53.824841 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:53.825973 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:53.826681 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:53.827355 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:53.979419 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:53.988154 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2d513427-fd7f-4e85-8f97-2f4c9f3ed579 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1266 microversion: 2.1 time: 0.181319 Sep 26 06:09:53.988733 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 590/1188] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:53 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:55.012555 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:55.013275 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:55.021036 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:55.021660 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:55.022178 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:55.022995 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:55.023520 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:55.024004 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:55.177394 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:55.189030 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-28dfd410-c7e1-46ef-815a-86ea17bd43e3 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1452 microversion: 2.1 time: 0.180805 Sep 26 06:09:55.189816 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 599/1189] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:55 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:55.217305 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:09:55.217898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:09:55.224877 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:55.225388 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:55.225827 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:55.226537 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:55.226991 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:55.227410 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:55.365422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:09:55.374924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-8a58bdcb-e394-46b5-8d7d-8c608c6a414a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1452 microversion: 2.1 time: 0.161579 Sep 26 06:09:55.375507 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 591/1190] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:09:55 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:09:57.148488 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-4f332789-504e-4312-a9c7-b7b54a6b2d2c req-421581b0-be9e-4d8f-a3c6-9e8ce6a4d4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19203c-c625-4707-bcbe-6f2d4f1bb4a8", "tag": "c79b31ed-a06b-46fe-b0c8-31d92ae98c84"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:09:57.158385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-4f332789-504e-4312-a9c7-b7b54a6b2d2c req-421581b0-be9e-4d8f-a3c6-9e8ce6a4d4d7 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:09:57.158920 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-4f332789-504e-4312-a9c7-b7b54a6b2d2c req-421581b0-be9e-4d8f-a3c6-9e8ce6a4d4d7 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:09:57.159346 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-4f332789-504e-4312-a9c7-b7b54a6b2d2c req-421581b0-be9e-4d8f-a3c6-9e8ce6a4d4d7 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:09:57.172506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-4f332789-504e-4312-a9c7-b7b54a6b2d2c req-421581b0-be9e-4d8f-a3c6-9e8ce6a4d4d7 service nova] Creating event network-changed:c79b31ed-a06b-46fe-b0c8-31d92ae98c84 for instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 on hv-cinder-83608 Sep 26 06:09:57.178019 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-4f332789-504e-4312-a9c7-b7b54a6b2d2c req-421581b0-be9e-4d8f-a3c6-9e8ce6a4d4d7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033477 Sep 26 06:09:57.178802 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 600/1191] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:11:46.937468 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] AMQP server on 10.222.0.57:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 26 06:11:46.938124 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_api:SELECT=22 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:11:46.938799 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG dbcounter [-] [127274] Writing DB stats nova_cell1:SELECT=50 {{(pid=127274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:11:46.938946 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:46.939705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:46.939896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 06:11:46.940067 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 06:11:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.57) !!! Sep 26 06:11:46.941260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 06:11:46.941260 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Mon Sep 26 06:11:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.57) !!! Sep 26 06:11:46.942347 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:11:46.943812 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG dbcounter [-] [127275] Writing DB stats nova_cell1:SELECT=48 {{(pid=127275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:11:46.946230 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 06:11:46.946367 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Mon Sep 26 06:11:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 (ip 10.222.0.57) !!! Sep 26 06:11:46.956021 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:46.956519 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:46.956955 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:46.957684 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:46.957808 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-bf4b7d65-345f-484a-908d-4e4e71395e70 req-ccdca0da-d79b-40b0-9705-00c7f69d126e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e19203c-c625-4707-bcbe-6f2d4f1bb4a8", "tag": "c79b31ed-a06b-46fe-b0c8-31d92ae98c84"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:11:46.958134 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:46.958591 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:46.971112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-bf4b7d65-345f-484a-908d-4e4e71395e70 req-ccdca0da-d79b-40b0-9705-00c7f69d126e service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:46.973588 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-bf4b7d65-345f-484a-908d-4e4e71395e70 req-ccdca0da-d79b-40b0-9705-00c7f69d126e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:46.974057 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-bf4b7d65-345f-484a-908d-4e4e71395e70 req-ccdca0da-d79b-40b0-9705-00c7f69d126e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:46.985341 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-bf4b7d65-345f-484a-908d-4e4e71395e70 req-ccdca0da-d79b-40b0-9705-00c7f69d126e service nova] Creating event network-changed:c79b31ed-a06b-46fe-b0c8-31d92ae98c84 for instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 on hv-cinder-83608 Sep 26 06:11:46.989655 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 06:11:46.990586 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-bf4b7d65-345f-484a-908d-4e4e71395e70 req-ccdca0da-d79b-40b0-9705-00c7f69d126e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055026 Sep 26 06:11:46.991365 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 601/1192] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 06:11:47.080368 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-ed1ee662-2d7e-4992-b251-5c473b0308d9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 204 len: 0 microversion: 2.1 time: 0.146737 Sep 26 06:11:47.084372 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 592/1193] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 06:11:46 2022] DELETE /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 06:11:47.091439 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:47.092281 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:47.099963 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:47.100506 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:47.100950 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:47.101672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:47.102116 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:47.102564 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:47.240876 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:11:47.249059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-57c5960b-99f6-4836-b550-2c520f73038a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1577 microversion: 2.1 time: 0.163241 Sep 26 06:11:47.264924 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 602/1194] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:47 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:11:48.273150 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:48.273860 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:48.280692 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:48.280970 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:48.281428 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:48.282132 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:48.282624 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:48.282996 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:48.481568 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:11:48.489805 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-d674ecab-7030-4fa7-a61c-2f2e9fb4b162 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1577 microversion: 2.1 time: 0.220986 Sep 26 06:11:48.490322 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 593/1195] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:48 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:11:49.466101 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-343c8e7e-6a3b-45a3-b3d6-af67e2c98193 req-98c3a3c8-4605-4cc8-aca4-3986c1c71a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e19203c-c625-4707-bcbe-6f2d4f1bb4a8", "name": "network-vif-deleted", "tag": "c79b31ed-a06b-46fe-b0c8-31d92ae98c84"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:11:49.478584 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-343c8e7e-6a3b-45a3-b3d6-af67e2c98193 req-98c3a3c8-4605-4cc8-aca4-3986c1c71a74 service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:49.479059 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-343c8e7e-6a3b-45a3-b3d6-af67e2c98193 req-98c3a3c8-4605-4cc8-aca4-3986c1c71a74 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:49.479481 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-343c8e7e-6a3b-45a3-b3d6-af67e2c98193 req-98c3a3c8-4605-4cc8-aca4-3986c1c71a74 service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:49.491909 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-343c8e7e-6a3b-45a3-b3d6-af67e2c98193 req-98c3a3c8-4605-4cc8-aca4-3986c1c71a74 service nova] Creating event network-vif-deleted:c79b31ed-a06b-46fe-b0c8-31d92ae98c84 for instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 on hv-cinder-83608 Sep 26 06:11:49.496483 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO oslo.messaging._drivers.impl_rabbit [-] [f2c558f4-8f25-40f8-be28-b74d01a54d4d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 48884. Sep 26 06:11:49.498172 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-343c8e7e-6a3b-45a3-b3d6-af67e2c98193 req-98c3a3c8-4605-4cc8-aca4-3986c1c71a74 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035877 Sep 26 06:11:49.498778 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 603/1196] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:11:49.513592 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:49.514204 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:49.521622 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:49.522106 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:49.522538 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:49.523229 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:49.523680 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:49.524107 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:49.591422 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:11:49.603835 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-247bc182-ee23-44a2-94fd-c4658c36c3a9 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 200 len: 1225 microversion: 2.1 time: 0.094197 Sep 26 06:11:49.604404 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 594/1197] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:49 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:11:50.632775 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:50.633820 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:50.644328 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:50.644811 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:50.645295 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:50.645981 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:50.646430 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:50.646896 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:50.660434 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] HTTP exception thrown: Instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 could not be found. Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Request method failure captured: Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 HTTP/1.1 Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMUDRwhE9I0sae01H-wL-hZujCBtRl56FMOZO5XxDhbPvseNFzNS_1oGyQ2DF-dKPO57bIgmrlxPByIU0l_DmnUBE-felAJAgdVfsCGVbIbhiIAg1tt2NC4x8lulHYBGNGYKSJWfSMTuT9Otaf37ZyZOvFBeJQTWuARxAjCSqgKZNGvY Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 06:11:50.662096 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fe22d212c0eb4df3800b0e80d722e217", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: ff51bc306c6444ac99ac4c93ea63ac7f Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 could not be found. Sep 26 06:11:50.664000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '8e19203c-c625-4707-bcbe-6f2d4f1bb4a8'} Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 could not be found. Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 06:11:50.665112 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 could not be found. Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 could not be found. Sep 26 06:11:50.666821 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:50.668153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Returning 404 to user: Instance 8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 06:11:50.668153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a4200d3c-909d-446c-b9f5-638d31fa891a tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8" status: 404 len: 111 microversion: 2.1 time: 0.038546 Sep 26 06:11:50.668153 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 604/1198] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:50 2022] GET /compute/v2.1/servers/8e19203c-c625-4707-bcbe-6f2d4f1bb4a8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 06:11:53.804206 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:53.804747 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:53.806425 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-ec6886c9-46d9-4d61-81ca-00da209c8446 req-d67bb577-bacb-4728-94b4-fb1326b9cc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba6f9bf-29a7-4164-a989-efe1687e25e5", "tag": "7a9c18ef-ab34-42cb-9f25-1dd370c4d939"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:11:53.812391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:53.812391 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:53.812705 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:53.813509 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:53.813993 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:53.814653 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:53.816443 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ec6886c9-46d9-4d61-81ca-00da209c8446 req-d67bb577-bacb-4728-94b4-fb1326b9cc4e service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:53.817599 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ec6886c9-46d9-4d61-81ca-00da209c8446 req-d67bb577-bacb-4728-94b4-fb1326b9cc4e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:53.818020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-ec6886c9-46d9-4d61-81ca-00da209c8446 req-d67bb577-bacb-4728-94b4-fb1326b9cc4e service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:53.829892 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-ec6886c9-46d9-4d61-81ca-00da209c8446 req-d67bb577-bacb-4728-94b4-fb1326b9cc4e service nova] Creating event network-changed:7a9c18ef-ab34-42cb-9f25-1dd370c4d939 for instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 on hv-cinder-83608 Sep 26 06:11:53.835130 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-ec6886c9-46d9-4d61-81ca-00da209c8446 req-d67bb577-bacb-4728-94b4-fb1326b9cc4e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032731 Sep 26 06:11:53.836038 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 605/1199] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:11:53.844436 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Going to try to terminate instance {{(pid=127275) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 06:11:53.933646 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-6ded1e6a-aa1a-4414-a704-2a9058992c71 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 204 len: 0 microversion: 2.1 time: 0.133247 Sep 26 06:11:53.934708 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 595/1200] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 06:11:53 2022] DELETE /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 06:11:53.944248 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:53.945037 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:53.951797 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:53.952360 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:53.952850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:53.953672 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:53.954196 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:53.954687 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:54.097724 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.policy [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127274) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:11:54.105706 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a80f380e-3597-4914-8156-eab6ff59352b tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1578 microversion: 2.1 time: 0.166271 Sep 26 06:11:54.106271 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 606/1201] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:53 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:11:55.130885 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:55.131586 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:55.138243 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:55.138749 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:55.139165 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:55.139890 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:55.140343 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:55.140797 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:55.339201 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:11:55.349083 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-22600e3a-570c-4ec0-9523-2c9521a57cea tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1578 microversion: 2.1 time: 0.222578 Sep 26 06:11:55.349898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 596/1202] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:55 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:11:56.184836 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [req-8242eb62-a5a6-4c29-b9b9-353c7d43f461 req-9b901b0e-21d4-427f-b74a-d0f44ef3b26a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba6f9bf-29a7-4164-a989-efe1687e25e5", "name": "network-vif-deleted", "tag": "7a9c18ef-ab34-42cb-9f25-1dd370c4d939"}]} {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 06:11:56.195111 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-8242eb62-a5a6-4c29-b9b9-353c7d43f461 req-9b901b0e-21d4-427f-b74a-d0f44ef3b26a service nova] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:56.195577 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-8242eb62-a5a6-4c29-b9b9-353c7d43f461 req-9b901b0e-21d4-427f-b74a-d0f44ef3b26a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:56.195991 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [req-8242eb62-a5a6-4c29-b9b9-353c7d43f461 req-9b901b0e-21d4-427f-b74a-d0f44ef3b26a service nova] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:56.207356 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.compute.server_external_events [req-8242eb62-a5a6-4c29-b9b9-353c7d43f461 req-9b901b0e-21d4-427f-b74a-d0f44ef3b26a service nova] Creating event network-vif-deleted:7a9c18ef-ab34-42cb-9f25-1dd370c4d939 for instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 on hv-cinder-83608 Sep 26 06:11:56.212272 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [req-8242eb62-a5a6-4c29-b9b9-353c7d43f461 req-9b901b0e-21d4-427f-b74a-d0f44ef3b26a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031123 Sep 26 06:11:56.212867 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 607/1203] 10.222.0.57 () {64 vars in 1317 bytes} [Mon Sep 26 06:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 06:11:56.378888 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:56.379822 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:56.390669 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:56.391361 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:56.392068 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:56.393200 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:56.393987 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:56.394677 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:56.464578 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.policy [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff51bc306c6444ac99ac4c93ea63ac7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe22d212c0eb4df3800b0e80d722e217', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127275) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 06:11:56.472804 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-32326eba-60a4-4a5a-b7d7-080ed76bf028 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 200 len: 1225 microversion: 2.1 time: 0.100262 Sep 26 06:11:56.484425 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 597/1204] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:56 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 06:11:57.502154 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:57.503238 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 5ba6f9bf-29a7-4164-a989-efe1687e25e5] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:57.511363 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:57.511848 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:57.512289 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:57.512979 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:57.513464 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:57.513916 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:57.527567 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] HTTP exception thrown: Instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 could not be found. Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Request method failure captured: Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 HTTP/1.1 Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMUDRwhE9I0sae01H-wL-hZujCBtRl56FMOZO5XxDhbPvseNFzNS_1oGyQ2DF-dKPO57bIgmrlxPByIU0l_DmnUBE-felAJAgdVfsCGVbIbhiIAg1tt2NC4x8lulHYBGNGYKSJWfSMTuT9Otaf37ZyZOvFBeJQTWuARxAjCSqgKZNGvY Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 06:11:57.529163 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fe22d212c0eb4df3800b0e80d722e217", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: ff51bc306c6444ac99ac4c93ea63ac7f Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 could not be found. Sep 26 06:11:57.530854 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '5ba6f9bf-29a7-4164-a989-efe1687e25e5'} Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 could not be found. Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 06:11:57.531850 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 could not be found. Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 could not be found. Sep 26 06:11:57.533541 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:57.535000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Returning 404 to user: Instance 5ba6f9bf-29a7-4164-a989-efe1687e25e5 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 06:11:57.535000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-db3b8792-2211-4b6e-bfea-f8a6acf39f9e tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5" status: 404 len: 111 microversion: 2.1 time: 0.036762 Sep 26 06:11:57.535000 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 608/1205] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:57 2022] GET /compute/v2.1/servers/5ba6f9bf-29a7-4164-a989-efe1687e25e5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 06:11:57.993036 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:57.993615 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.compute.api [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127275) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:58.000446 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:58.000924 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:58.001382 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:58.002066 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:58.002504 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:58.002898 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG oslo_concurrency.lockutils [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:58.016354 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.wsgi [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] HTTP exception thrown: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Request method failure captured: Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: request: DELETE /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 HTTP/1.1 Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept: application/json Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Accept-Encoding: identity Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Connection: close Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Length: 0 Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Content-Type: application/json Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Host: 10.222.0.57 Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: Openstack-System-Scope: None Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: User-Agent: python-urllib3/1.26.12 Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Auth-Token: gAAAAABjMUDRwhE9I0sae01H-wL-hZujCBtRl56FMOZO5XxDhbPvseNFzNS_1oGyQ2DF-dKPO57bIgmrlxPByIU0l_DmnUBE-felAJAgdVfsCGVbIbhiIAg1tt2NC4x8lulHYBGNGYKSJWfSMTuT9Otaf37ZyZOvFBeJQTWuARxAjCSqgKZNGvY Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Id: None Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Domain-Name: None Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Identity-Status: Confirmed Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Is-Admin-Project: True Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Id: default Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Domain-Name: Default Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Project-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Role: reader,member Sep 26 06:11:58.018052 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Roles: reader,member Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fe22d212c0eb4df3800b0e80d722e217", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-Tenant-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Id: default Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Domain-Name: Default Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Id: ff51bc306c6444ac99ac4c93ea63ac7f Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: X-User-Name: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: method: > Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: exception: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.019786 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: action_args: {'id': '4569e22c-f206-456d-b9c1-a141f9f1b073'} Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 06:11:58.020840 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.022596 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.024255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Returning 404 to user: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. {{(pid=127275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 06:11:58.024255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-22f70978-a3a4-4b28-b58d-8fa5ce9395be tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 404 len: 111 microversion: 2.1 time: 0.030450 Sep 26 06:11:58.024255 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 598/1206] 10.222.0.57 () {58 vars in 1239 bytes} [Mon Sep 26 06:11:57 2022] DELETE /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 06:11:58.028603 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '>' {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:58.029367 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.compute.api [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] [instance: 4569e22c-f206-456d-b9c1-a141f9f1b073] Fetching instance by UUID {{(pid=127274) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 06:11:58.035720 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:58.036206 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:58.036644 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:58.037385 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Acquiring lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 06:11:58.037905 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 06:11:58.038330 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG oslo_concurrency.lockutils [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Lock "efcbfa72-6b16-406c-b5c5-ca53c6356a25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 06:11:58.051751 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.wsgi [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] HTTP exception thrown: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Request method failure captured: Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: request: GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 HTTP/1.1 Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept: application/json Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Accept-Encoding: identity Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Connection: close Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Length: 0 Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Content-Type: application/json Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Host: 10.222.0.57 Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: Openstack-System-Scope: None Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: User-Agent: python-urllib3/1.26.12 Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Auth-Token: gAAAAABjMUDRwhE9I0sae01H-wL-hZujCBtRl56FMOZO5XxDhbPvseNFzNS_1oGyQ2DF-dKPO57bIgmrlxPByIU0l_DmnUBE-felAJAgdVfsCGVbIbhiIAg1tt2NC4x8lulHYBGNGYKSJWfSMTuT9Otaf37ZyZOvFBeJQTWuARxAjCSqgKZNGvY Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Id: None Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Domain-Name: None Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Identity-Status: Confirmed Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Is-Admin-Project: True Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Id: default Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Domain-Name: Default Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Project-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Role: reader,member Sep 26 06:11:58.053340 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Roles: reader,member Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fe22d212c0eb4df3800b0e80d722e217"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fe22d212c0eb4df3800b0e80d722e217", "adminURL": "http://10.222.0.57:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}] Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Id: fe22d212c0eb4df3800b0e80d722e217 Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-Tenant-Name: tempest-TestVolumeBootPattern-882261853 Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Id: default Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Domain-Name: Default Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Id: ff51bc306c6444ac99ac4c93ea63ac7f Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: X-User-Name: tempest-TestVolumeBootPattern-882261853-project Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: method: > Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: exception: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.055381 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: action_args: {'id': '4569e22c-f206-456d-b9c1-a141f9f1b073'} Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: {{(pid=127274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 06:11:58.056252 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. Sep 26 06:11:58.057762 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: ERROR nova.api.openstack.wsgi Sep 26 06:11:58.059020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: DEBUG nova.api.openstack.wsgi [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Returning 404 to user: Instance 4569e22c-f206-456d-b9c1-a141f9f1b073 could not be found. {{(pid=127274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 06:11:58.059020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: INFO nova.api.openstack.requestlog [None req-a8220c8d-fc8d-41c3-a0bd-88ded9668073 tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073" status: 404 len: 111 microversion: 2.1 time: 0.030032 Sep 26 06:11:58.059020 dv-cinder-836083-14-iscsi devstack@n-api.service[127274]: [pid: 127274|app: 0|req: 609/1207] 10.222.0.57 () {58 vars in 1236 bytes} [Mon Sep 26 06:11:58 2022] GET /compute/v2.1/servers/4569e22c-f206-456d-b9c1-a141f9f1b073 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 06:11:59.375050 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: DEBUG nova.api.openstack.wsgi [None req-2488864d-fa15-47cb-b247-602a35d4dddc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] Calling method '.version_select at 0x7f1e5e33dee0>' {{(pid=127275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 06:11:59.401603 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: INFO nova.api.openstack.requestlog [None req-2488864d-fa15-47cb-b247-602a35d4dddc tempest-TestVolumeBootPattern-882261853 tempest-TestVolumeBootPattern-882261853-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-176529439" status: 202 len: 0 microversion: 2.1 time: 0.030628 Sep 26 06:11:59.403324 dv-cinder-836083-14-iscsi devstack@n-api.service[127275]: [pid: 127275|app: 0|req: 599/1208] 10.222.0.57 () {58 vars in 1260 bytes} [Mon Sep 26 06:11:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-176529439 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)